Jul 06 12:00:06 devstack cinder-volume[75461]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 12:00:06 devstack cinder-volume[75461]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 12:00:06 devstack cinder-volume[75461]: we strongly recommend against using it for new projects. Jul 06 12:00:06 devstack cinder-volume[75461]: If you are already using Eventlet, we recommend migrating to a different Jul 06 12:00:06 devstack cinder-volume[75461]: framework. For more detail see Jul 06 12:00:06 devstack cinder-volume[75461]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 12:00:06 devstack cinder-volume[75461]: import eventlet # noqa Jul 06 12:00:09 devstack cinder-volume[75461]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:00:09 devstack cinder-volume[75461]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:00:09 devstack cinder-volume[75461]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:00:10 devstack cinder-volume[75461]: INFO dbcounter [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Registered counter for database cinder Jul 06 12:00:10 devstack cinder-volume[75461]: DEBUG oslo_db.sqlalchemy.engines [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75461) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:00:10 devstack cinder-volume[75461]: DEBUG dbcounter [-] [75461] Writer thread running {{(pid=75461) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:00:10 devstack cinder-volume[75461]: INFO cinder.rpc [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 12:00:10 devstack cinder-volume[75461]: INFO cinder.rpc [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_db.sqlalchemy.engines [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75461) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:00:11 devstack cinder-volume[75461]: INFO cinder.volume.manager [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Determined volume DB was empty at startup. Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG cinder.volume.manager [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75461) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 12:00:11 devstack cinder-volume[75461]: INFO cinder.volume.manager [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 12:00:11 devstack cinder-volume[75461]: WARNING stevedore.named [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 12:00:11 devstack cinder-volume[75461]: WARNING castellan.key_manager [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:00:11 devstack cinder-volume[75461]: WARNING cinder.keymgr.conf_key_mgr [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG cinder.volume.drivers.lvm [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75461) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_concurrency.processutils [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75461) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_concurrency.processutils [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.390s {{(pid=75461) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_db.sqlalchemy.engines [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75461) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:00:11 devstack cinder-volume[75461]: INFO cinder.rpc [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 06 12:00:11 devstack cinder-volume[75461]: INFO cinder.rpc [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 06 12:00:11 devstack cinder-volume[75461]: WARNING stevedore.named [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 12:00:11 devstack cinder-volume[75461]: WARNING castellan.key_manager [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:00:11 devstack cinder-volume[75461]: INFO cinder.volume.manager [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_db.sqlalchemy.engines [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75461) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:00:11 devstack cinder-volume[75461]: INFO oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Starting 1 workers Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Started child 75632 {{(pid=75461) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Full set of CONF: {{(pid=75461) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] ******************************************************************************** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Configuration options gathered from: {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] ================================================================================ {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] allow_availability_zone_fallback = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] allow_compression_on_image_upload = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] allowed_direct_url_schemes = [] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] api_rate_limit = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75632]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] auth_strategy = keystone {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] az_cache_duration = 3600 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_availability_zone = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_host = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_name = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_stats_polling_interval = 60 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backup_api_class = cinder.backup.api.API {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backup_name_template = backup-%s {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backup_use_same_host = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backup_use_temp_snapshot = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] chap_password = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] chap_username = {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cinder_internal_tenant_project_id = 6bea78bfb53c4a1ea3d8e1c78f2591d2 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cinder_internal_tenant_user_id = c61c1aefba114e6193469a8af4c56cf6 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cloned_volume_same_az = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cluster = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] compression_format = gzip {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] compute_api_class = cinder.compute.nova.API {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] config_dir = [] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] config_source = [] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] control_exchange = openstack {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] debug = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] default_availability_zone = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] default_group_type = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] default_volume_type = lvmdriver-1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] disk_geometry = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] driver_client_cert = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] driver_client_cert_key = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] driver_data_namespace = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] driver_ssl_cert_path = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] driver_ssl_cert_verify = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] driver_use_ssl = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] enable_force_upload = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] enable_new_services = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] enable_unsupported_driver = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] enforce_multipath_for_image_xfer = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] filter_function = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance_api_insecure = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance_api_servers = ['http://192.168.122.246/image'] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance_api_ssl_compression = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance_ca_certificates_file = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance_catalog_info = image:glance:publicURL {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance_certfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance_keyfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance_num_retries = 3 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance_request_timeout = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] goodness_function = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] graceful_shutdown_timeout = 5 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] group_api_class = cinder.group.api.API {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] host = devstack {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] image_compress_on_upload = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] image_conversion_address_space_limit = 1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] image_conversion_cpu_limit = 60 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] image_conversion_disable = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] image_upload_use_cinder_backend = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] image_upload_use_internal_tenant = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] image_volume_cache_enabled = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] image_volume_cache_max_count = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] image_volume_cache_max_size_gb = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] init_host_max_objects_retrieval = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] instance_format = [instance: %(uuid)s] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] iscsi_target_flags = {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] iscsi_write_cache = on {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] iser_helper = tgtadm {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] iser_ip_address = 192.168.122.246 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] iser_port = 3260 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] log_color = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] log_config_append = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] log_dir = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] log_file = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] log_options = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] log_rotate_interval = 1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] log_rotate_interval_type = days {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] log_rotation_type = none {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] max_age = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] max_logfile_count = 30 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] max_logfile_size_mb = 200 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] max_over_subscription_ratio = 20.0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] message_reap_interval = 86400 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] message_ttl = 2592000 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] migration_create_volume_timeout_secs = 300 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] monkey_patch = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] monkey_patch_modules = [] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] my_ip = 192.168.122.246 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] no_snapshot_gb_quota = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] num_iser_scan_tries = 3 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] num_shell_tries = 3 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] num_volume_device_scan_tries = 3 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] nvmeof_conn_info_version = 1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] nvmet_ns_id = 10 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] nvmet_port_id = 1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] osapi_max_limit = 1000 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] osapi_volume_ext_list = [] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] osapi_volume_listen_port = 8776 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] osapi_volume_use_ssl = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] osapi_volume_workers = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] per_volume_size_limit = -1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] periodic_fuzzy_delay = 60 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] periodic_interval = 60 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] public_endpoint = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] publish_errors = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] quota_backup_gigabytes = 1000 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] quota_backups = 10 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] quota_gigabytes = 1000 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] quota_groups = 10 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] quota_snapshots = 10 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] quota_volumes = 10 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] rate_limit_burst = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] rate_limit_except_level = CRITICAL {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] rate_limit_interval = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] reinit_driver_count = 3 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] replication_device = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] report_discard_supported = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] report_interval = 120 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] reservation_clean_interval = 86400 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] reservation_expire = 86400 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] reserved_image_namespaces = [] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] reserved_percentage = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] rpc_response_timeout = 120 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] run_external_periodic_tasks = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] scst_target_driver = iscsi {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] scst_target_iqn_name = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] service_down_time = 720 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] shell_completion = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] snapshot_name_template = snapshot-%s {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] snapshot_same_host = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] split_loggers = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] state_path = /opt/stack/data/cinder {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] storage_availability_zone = nova {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] storage_protocol = iSCSI {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] syslog_log_facility = LOG_USER {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] target_helper = lioadm {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] target_ip_address = 192.168.122.246 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] target_port = 3260 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] target_protocol = iscsi {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] target_secondary_ip_addresses = [] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] trace_flags = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] transport_url = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] until_refresh = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] use_chap_auth = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] use_default_quota_class = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] use_journal = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] use_json = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] use_multipath_for_image_xfer = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] use_stderr = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] use_syslog = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] verify_glance_signatures = enabled {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] volume_api_class = cinder.volume.api.API {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] volume_backend_name = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] volume_clear = zero {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] volume_clear_ionice = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] volume_clear_size = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] volume_copy_bps_limit = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] volume_dd_blocksize = 1M {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] volume_name_template = volume-%s {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] volume_service_inithost_offload = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] volume_usage_audit_period = month {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] zoning_mode = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_concurrency.disable_process_locking = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75632]: INFO cinder.volume.manager [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.auth_section = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.auth_type = password {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.auth_version = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.cache = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.certfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.include_service_catalog = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.insecure = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.interface = public {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.keyfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_password = {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcache_username = {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.region_name = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.service_type = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.246/identity {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.backend = dogpile.cache.null {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.backend_argument = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.backend_expiration_time = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.config_prefix = cache.oslo {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.debug_cache_backend = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.enable_retry_client = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.enable_socket_keepalive = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.enabled = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.expiration_time = 600 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.hashclient_retry_attempts = 2 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.memcache_dead_retry = 300 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.memcache_pool_maxsize = 10 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.memcache_sasl_enabled = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.password = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.proxies = [] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.redis_db = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.redis_server = localhost:6379 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.retry_attempts = 2 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.retry_delay = 0.0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.socket_keepalive_count = 1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.socket_keepalive_idle = 1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.socket_keepalive_interval = 1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.socket_timeout = 1.0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.tls_allowed_ciphers = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.tls_cafile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.tls_certfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.tls_enabled = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.tls_keyfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cache.username = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] coordination.backend_url = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.asyncio_connection = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.asyncio_slave_connection = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.backend = sqlalchemy {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.connection = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.connection_debug = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.connection_parameters = {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.connection_recycle_time = 3600 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.connection_trace = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.db_inc_retry_interval = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.db_max_retries = 20 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.db_max_retry_interval = 10 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.db_retry_interval = 1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.max_overflow = 50 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.max_pool_size = 5 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.max_retries = 10 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.mysql_wsrep_sync_wait = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.pool_timeout = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.retry_interval = 10 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.slave_connection = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.sqlite_synchronous = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.synchronous_reader = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] database.use_db_reconnect = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] profiler.connection_string = messaging:// {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] profiler.enabled = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] profiler.es_doc_type = notification {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] profiler.es_scroll_size = 10000 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] profiler.es_scroll_time = 2m {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] profiler.filter_error_trace = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] profiler.hmac_keys = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] profiler.sentinel_service_name = mymaster {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] profiler.socket_timeout = 0.1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] profiler.trace_requests = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] profiler.trace_sqlalchemy = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] profiler_jaeger.process_tags = {} {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] profiler_jaeger.service_name_prefix = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] profiler_otlp.service_name_prefix = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_policy.enforce_new_defaults = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_policy.enforce_scope = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_policy.policy_default_rule = default {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_policy.policy_file = policy.yaml {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] privsep_osbrick.group = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] privsep_osbrick.helper_command = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] privsep_osbrick.user = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cinder_sys_admin.group = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cinder_sys_admin.helper_command = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] cinder_sys_admin.user = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] service_user.auth_section = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] service_user.auth_type = password {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] service_user.cafile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] service_user.certfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] service_user.collect_timing = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] service_user.insecure = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] service_user.keyfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] service_user.send_service_user_token = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] service_user.split_loggers = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] service_user.timeout = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance.auth_section = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance.auth_type = password {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance.certfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance.collect_timing = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance.insecure = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance.keyfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance.region_name = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance.split_loggers = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] glance.timeout = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.backend_availability_zone = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.chap_password = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.chap_username = {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.disk_geometry = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.driver_client_cert = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.driver_client_cert_key = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.driver_data_namespace = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:11 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.driver_use_ssl = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.extra_capabilities = {} {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.filter_function = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.goodness_function = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.iscsi_target_flags = {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.iscsi_write_cache = on {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.iser_helper = tgtadm {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.iser_ip_address = 192.168.122.246 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.iser_port = 3260 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.lvm_share_target = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.lvm_type = auto {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.num_shell_tries = 3 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.replication_device = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.report_discard_supported = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.reserved_percentage = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.target_helper = tgtadm {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.target_ip_address = 192.168.122.246 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.target_port = 3260 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.target_protocol = iscsi {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.trace_flags = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.unique_fqdn_network = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.use_chap_auth = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.volume_backend_name = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.volume_clear = zero {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.volume_clear_ionice = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.volume_clear_size = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_reports.file_event_handler = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_reports.log_dir = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.backend_host = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.chap_password = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.chap_username = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.disk_geometry = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.driver_client_cert = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.extra_capabilities = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.filter_function = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.goodness_function = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.iser_helper = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.iser_ip_address = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.iser_port = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.lvm_share_target = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.lvm_type = auto {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.num_shell_tries = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.replication_device = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.report_discard_supported = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.reserved_percentage = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.scst_target_driver = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.storage_protocol = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.target_helper = lioadm {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.target_ip_address = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.target_port = 3260 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.trace_flags = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.use_chap_auth = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.volume_clear = zero {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack sudo[75636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.volume_clear_size = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] lvmdriver-1.volumes_dir = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack sudo[75636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:11 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.ssl = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_notifications.driver = [] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_notifications.retry = -1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] key_manager.fixed_key = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.barbican_api_version = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.barbican_endpoint = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.barbican_endpoint_type = public {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.barbican_region_name = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.cafile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.certfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.collect_timing = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.insecure = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.keyfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.number_of_retries = 60 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.retry_delay = 1 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.send_service_user_token = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.split_loggers = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.timeout = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.verify_ssl = True {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican.verify_ssl_path = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican_service_user.auth_section = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican_service_user.auth_type = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican_service_user.cafile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican_service_user.certfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican_service_user.collect_timing = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican_service_user.insecure = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican_service_user.keyfile = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican_service_user.split_loggers = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] barbican_service_user.timeout = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] vault.approle_role_id = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] vault.approle_secret_id = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] vault.kv_mountpoint = secret {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] vault.kv_path = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] vault.kv_version = 2 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] vault.namespace = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] vault.root_token_id = **** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] vault.ssl_ca_crt_file = None {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] vault.timeout = 60.0 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] vault.use_ssl = False {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:12 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] ******************************************************************************** {{(pid=75461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 12:00:12 devstack sudo[75636]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:12 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:12 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:12 devstack sudo[75642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:12 devstack sudo[75642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:13 devstack sudo[75642]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:13 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.662s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:13 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:00:13 devstack cinder-volume[75632]: INFO cinder.brick.local_dev.lvm [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 06 12:00:13 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:13 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:13 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:13 devstack sudo[75867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:00:13 devstack sudo[75867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:14 devstack sudo[75867]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:14 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.731s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:14 devstack cinder-volume[75632]: DEBUG cinder.brick.local_dev.lvm [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75632) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 06 12:00:14 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:14 devstack sudo[76106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:14 devstack sudo[76106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:15 devstack sudo[76106]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:15 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.637s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:15 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:15 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:15 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:15 devstack sudo[76399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:15 devstack sudo[76399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:16 devstack sudo[76399]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:16 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:16 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:16 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:16 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:16 devstack sudo[76416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 06 12:00:16 devstack sudo[76416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:17 devstack sudo[76416]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:17 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.670s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:17 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:17 devstack sudo[76420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:00:17 devstack sudo[76420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:17 devstack sudo[76420]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:17 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.754s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:17 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:17 devstack sudo[76430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:00:17 devstack sudo[76430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:18 devstack sudo[76430]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:18 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.773s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:18 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:18 devstack sudo[76435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:00:18 devstack sudo[76435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:19 devstack sudo[76435]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:19 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.912s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:19 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:19 devstack sudo[76446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:19 devstack sudo[76446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:20 devstack sudo[76446]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:20 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.703s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:20 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:20 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:20 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:20 devstack sudo[76484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:20 devstack sudo[76484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:21 devstack sudo[76484]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:21 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.821s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:21 devstack cinder-volume[75632]: INFO cinder.volume.drivers.lvm [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 06 12:00:21 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:21 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:21 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:21 devstack sudo[76490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:21 devstack sudo[76490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:21 devstack cinder-volume[75461]: DEBUG dbcounter [-] [75461] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75461) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:00:21 devstack sudo[76490]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:21 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.835s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:21 devstack cinder-volume[75632]: DEBUG cinder.volume.drivers.lvm [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Updating volume stats {{(pid=75632) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:00:21 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:21 devstack sudo[76528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:00:21 devstack sudo[76528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:22 devstack sudo[76528]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:22 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.793s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:22 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:22 devstack sudo[76618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:00:22 devstack sudo[76618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:23 devstack sudo[76618]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:23 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.780s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:23 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:23 devstack sudo[76758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:23 devstack sudo[76758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:24 devstack sudo[76758]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:24 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.701s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:24 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:24 devstack sudo[76761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:00:24 devstack sudo[76761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:24 devstack sudo[76761]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:24 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:24 devstack cinder-volume[75632]: INFO cinder.volume.driver [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Driver hasn't implemented _init_vendor_properties() Jul 06 12:00:24 devstack cinder-volume[75632]: DEBUG cinder.volume.driver [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75632) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 12:00:24 devstack cinder-volume[75632]: DEBUG oslo_db.sqlalchemy.engines [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75632) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:00:24 devstack cinder-volume[75632]: DEBUG dbcounter [-] [75632] Writer thread running {{(pid=75632) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:00:24 devstack cinder-volume[75632]: DEBUG cinder.db.api [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Building query based on filter {{(pid=75632) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 12:00:24 devstack cinder-volume[75632]: DEBUG cinder.image.image_utils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75632) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 12:00:24 devstack cinder-volume[75632]: INFO cinder.keymgr.migration [None req-927b3217-0eac-4533-9aa1-769c468f973f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 12:00:24 devstack cinder-volume[75632]: DEBUG cinder.volume.drivers.lvm [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Updating volume stats {{(pid=75632) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:00:24 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:25 devstack sudo[76766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:00:25 devstack sudo[76766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:25 devstack sudo[76766]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:25 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:25 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:25 devstack sudo[76772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:00:25 devstack sudo[76772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:26 devstack sudo[76772]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:26 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:26 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:26 devstack sudo[76775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:26 devstack sudo[76775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:27 devstack sudo[76775]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:27 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.714s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:27 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:27 devstack sudo[76778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:00:27 devstack sudo[76778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:27 devstack sudo[76778]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:27 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:27 devstack cinder-volume[75632]: DEBUG cinder.manager [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Notifying Schedulers of capabilities ... {{(pid=75632) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:00:27 devstack cinder-volume[75632]: INFO cinder.volume.manager [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Driver initialization completed successfully. Jul 06 12:00:27 devstack cinder-volume[75632]: INFO cinder.manager [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Initiating service 2 cleanup Jul 06 12:00:27 devstack cinder-volume[75632]: INFO cinder.manager [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Service 2 cleanup completed. Jul 06 12:00:27 devstack cinder-volume[75632]: DEBUG cinder.service [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Creating RPC server for service cinder-volume {{(pid=75632) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 12:00:27 devstack cinder-volume[75632]: DEBUG cinder.service [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75632) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 12:00:27 devstack cinder-volume[75632]: INFO cinder.volume.manager [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 06 12:00:27 devstack cinder-volume[75632]: DEBUG cinder.volume.drivers.lvm [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Updating volume stats {{(pid=75632) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:00:27 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:27 devstack sudo[76782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:00:27 devstack sudo[76782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:28 devstack sudo[76782]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:28 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.708s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:28 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:28 devstack sudo[76786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:00:28 devstack sudo[76786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:29 devstack sudo[76786]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:29 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.729s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:29 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:29 devstack sudo[76792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:29 devstack sudo[76792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:30 devstack sudo[76792]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:30 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.728s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:30 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:30 devstack sudo[76795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:00:30 devstack sudo[76795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:30 devstack sudo[76795]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:30 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:30 devstack cinder-volume[75632]: INFO cinder.volume.manager [None req-8a87f560-8594-4d77-9d3f-91e1a22c0249 None None] Driver post RPC initialization completed successfully. Jul 06 12:00:37 devstack cinder-volume[75632]: DEBUG oslo_service.periodic_task [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running periodic task VolumeManager._thread_info {{(pid=75632) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:00:37 devstack cinder-volume[75632]: DEBUG cinder.volume.manager [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] thread count: 6 {{(pid=75632) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:00:37 devstack cinder-volume[75632]: DEBUG cinder.volume.manager [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] thread info: [<_MainThread(MainThread, started 123130902507648)>, , , , , ] {{(pid=75632) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:00:37 devstack cinder-volume[75632]: DEBUG dbcounter [-] [75632] Writing DB stats cinder:SELECT=3 {{(pid=75632) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:00:40 devstack cinder-volume[75632]: DEBUG dbcounter [-] [75632] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75632) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:01:37 devstack cinder-volume[75632]: DEBUG oslo_service.periodic_task [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75632) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:01:37 devstack cinder-volume[75632]: DEBUG cinder.volume.drivers.lvm [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Updating volume stats {{(pid=75632) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:01:37 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:01:37 devstack sudo[78601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:01:37 devstack sudo[78601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:01:38 devstack sudo[78601]: pam_unix(sudo:session): session closed for user root Jul 06 12:01:38 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.719s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:01:38 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:01:38 devstack sudo[78604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:01:38 devstack sudo[78604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:01:39 devstack sudo[78604]: pam_unix(sudo:session): session closed for user root Jul 06 12:01:39 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.731s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:01:39 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:01:39 devstack sudo[78607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:01:39 devstack sudo[78607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:01:39 devstack sudo[78607]: pam_unix(sudo:session): session closed for user root Jul 06 12:01:39 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.720s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:01:39 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:01:39 devstack sudo[78610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:01:39 devstack sudo[78610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:01:40 devstack sudo[78610]: pam_unix(sudo:session): session closed for user root Jul 06 12:01:40 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:01:40 devstack cinder-volume[75632]: DEBUG cinder.manager [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Notifying Schedulers of capabilities ... {{(pid=75632) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:01:40 devstack cinder-volume[75632]: DEBUG oslo_service.periodic_task [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running periodic task VolumeManager._thread_info {{(pid=75632) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:01:40 devstack cinder-volume[75632]: DEBUG cinder.volume.manager [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] thread count: 6 {{(pid=75632) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:01:40 devstack cinder-volume[75632]: DEBUG cinder.volume.manager [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] thread info: [<_MainThread(MainThread, started 123130902507648)>, , , , , ] {{(pid=75632) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:02:37 devstack cinder-volume[75632]: DEBUG oslo_service.periodic_task [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75632) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:02:37 devstack cinder-volume[75632]: DEBUG cinder.volume.drivers.lvm [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Updating volume stats {{(pid=75632) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:02:37 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:37 devstack sudo[81917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:02:37 devstack sudo[81917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:38 devstack sudo[81917]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:38 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:38 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:38 devstack sudo[81936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:02:38 devstack sudo[81936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:38 devstack sudo[81936]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:38 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:38 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:39 devstack sudo[81940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:02:39 devstack sudo[81940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:39 devstack sudo[81940]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:39 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.638s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:39 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:39 devstack sudo[81944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:02:39 devstack sudo[81944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:40 devstack sudo[81944]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:40 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:40 devstack cinder-volume[75632]: DEBUG cinder.manager [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Notifying Schedulers of capabilities ... {{(pid=75632) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:02:40 devstack cinder-volume[75632]: DEBUG oslo_service.periodic_task [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running periodic task VolumeManager._thread_info {{(pid=75632) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:02:40 devstack cinder-volume[75632]: DEBUG cinder.volume.manager [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] thread count: 6 {{(pid=75632) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:02:40 devstack cinder-volume[75632]: DEBUG cinder.volume.manager [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] thread info: [<_MainThread(MainThread, started 123130902507648)>, , , , , ] {{(pid=75632) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:02:40 devstack cinder-volume[75632]: DEBUG dbcounter [-] [75632] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75632) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:03:37 devstack cinder-volume[75632]: DEBUG oslo_service.periodic_task [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75632) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:03:37 devstack cinder-volume[75632]: DEBUG cinder.volume.drivers.lvm [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Updating volume stats {{(pid=75632) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:03:37 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:03:37 devstack sudo[83933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:03:37 devstack sudo[83933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:03:38 devstack sudo[83933]: pam_unix(sudo:session): session closed for user root Jul 06 12:03:38 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.754s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:03:38 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:03:38 devstack sudo[83948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:03:38 devstack sudo[83948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:03:39 devstack sudo[83948]: pam_unix(sudo:session): session closed for user root Jul 06 12:03:39 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:03:39 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:03:39 devstack sudo[83952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:03:39 devstack sudo[83952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:03:39 devstack sudo[83952]: pam_unix(sudo:session): session closed for user root Jul 06 12:03:39 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.659s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:03:39 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:03:39 devstack sudo[83966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:03:39 devstack sudo[83966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:03:40 devstack sudo[83966]: pam_unix(sudo:session): session closed for user root Jul 06 12:03:40 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:03:40 devstack cinder-volume[75632]: DEBUG cinder.manager [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Notifying Schedulers of capabilities ... {{(pid=75632) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:03:40 devstack cinder-volume[75632]: DEBUG oslo_service.periodic_task [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running periodic task VolumeManager._thread_info {{(pid=75632) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:03:40 devstack cinder-volume[75632]: DEBUG cinder.volume.manager [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] thread count: 6 {{(pid=75632) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:03:40 devstack cinder-volume[75632]: DEBUG cinder.volume.manager [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] thread info: [<_MainThread(MainThread, started 123130902507648)>, , , , , ] {{(pid=75632) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:04:37 devstack cinder-volume[75632]: DEBUG oslo_service.periodic_task [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75632) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:04:37 devstack cinder-volume[75632]: DEBUG cinder.volume.drivers.lvm [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Updating volume stats {{(pid=75632) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:04:37 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:04:37 devstack sudo[85217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:04:37 devstack sudo[85217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:04:38 devstack sudo[85217]: pam_unix(sudo:session): session closed for user root Jul 06 12:04:38 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:04:38 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:04:38 devstack sudo[85243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:04:38 devstack sudo[85243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:04:39 devstack sudo[85243]: pam_unix(sudo:session): session closed for user root Jul 06 12:04:39 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:04:39 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:04:39 devstack sudo[85249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:04:39 devstack sudo[85249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:04:39 devstack sudo[85249]: pam_unix(sudo:session): session closed for user root Jul 06 12:04:39 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.613s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:04:39 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:04:39 devstack sudo[85255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:04:39 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:04:40 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root Jul 06 12:04:40 devstack cinder-volume[75632]: DEBUG oslo_concurrency.processutils [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=75632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:04:40 devstack cinder-volume[75632]: DEBUG cinder.manager [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Notifying Schedulers of capabilities ... {{(pid=75632) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:04:40 devstack cinder-volume[75632]: DEBUG oslo_service.periodic_task [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] Running periodic task VolumeManager._thread_info {{(pid=75632) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:04:40 devstack cinder-volume[75632]: DEBUG cinder.volume.manager [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] thread count: 6 {{(pid=75632) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:04:40 devstack cinder-volume[75632]: DEBUG cinder.volume.manager [None req-954e4e53-3a23-4a2e-80f1-0c3c504cd173 None None] thread info: [<_MainThread(MainThread, started 123130902507648)>, , , , , ] {{(pid=75632) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:04:40 devstack cinder-volume[75632]: DEBUG dbcounter [-] [75632] Writing DB stats cinder:SELECT=1 {{(pid=75632) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:04:40 devstack cinder-volume[75632]: DEBUG dbcounter [-] [75632] Writing DB stats cinder:UPDATE=1 {{(pid=75632) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:04:59 devstack cinder-volume[75461]: INFO oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Caught SIGTERM, stopping children Jul 06 12:04:59 devstack cinder-volume[75461]: DEBUG oslo_concurrency.lockutils [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Acquiring lock "singleton_lock" {{(pid=75461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:04:59 devstack cinder-volume[75461]: DEBUG oslo_concurrency.lockutils [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Acquired lock "singleton_lock" {{(pid=75461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:04:59 devstack cinder-volume[75461]: DEBUG oslo_concurrency.lockutils [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Releasing lock "singleton_lock" {{(pid=75461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:04:59 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Stop services. {{(pid=75461) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 12:04:59 devstack cinder-volume[75461]: DEBUG oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Killing children. {{(pid=75461) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 12:04:59 devstack cinder-volume[75461]: INFO oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Waiting on 1 children to exit Jul 06 12:05:02 devstack cinder-volume[75632]: DEBUG oslo_concurrency.lockutils [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Acquiring lock "singleton_lock" {{(pid=75632) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:05:02 devstack cinder-volume[75632]: DEBUG oslo_concurrency.lockutils [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Acquired lock "singleton_lock" {{(pid=75632) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:05:02 devstack cinder-volume[75632]: DEBUG oslo_concurrency.lockutils [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Releasing lock "singleton_lock" {{(pid=75632) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:05:02 devstack cinder-volume[75632]: WARNING amqp [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 12:05:02 devstack cinder-volume[75632]: WARNING amqp [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 12:05:02 devstack cinder-volume[75461]: INFO oslo_service.backend._eventlet.service [None req-ad805317-a1ff-40e4-a398-e98b158b18f5 None None] Child 75632 exited with status 0 Jul 06 12:05:03 devstack cinder-volume[85846]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 12:05:03 devstack cinder-volume[85846]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 12:05:03 devstack cinder-volume[85846]: we strongly recommend against using it for new projects. Jul 06 12:05:03 devstack cinder-volume[85846]: If you are already using Eventlet, we recommend migrating to a different Jul 06 12:05:03 devstack cinder-volume[85846]: framework. For more detail see Jul 06 12:05:03 devstack cinder-volume[85846]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 12:05:03 devstack cinder-volume[85846]: import eventlet # noqa Jul 06 12:05:05 devstack cinder-volume[85846]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85846) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:05:05 devstack cinder-volume[85846]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85846) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:05:05 devstack cinder-volume[85846]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85846) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:05:06 devstack cinder-volume[85846]: INFO dbcounter [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Registered counter for database cinder Jul 06 12:05:06 devstack cinder-volume[85846]: DEBUG oslo_db.sqlalchemy.engines [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85846) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:06 devstack cinder-volume[85846]: DEBUG dbcounter [-] [85846] Writer thread running {{(pid=85846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:05:06 devstack cinder-volume[85846]: INFO cinder.rpc [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 12:05:06 devstack cinder-volume[85846]: INFO cinder.rpc [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 12:05:06 devstack cinder-volume[85846]: DEBUG oslo_db.sqlalchemy.engines [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85846) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:06 devstack cinder-volume[85846]: INFO cinder.volume.manager [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Determined volume DB was empty at startup. Jul 06 12:05:06 devstack cinder-volume[85846]: DEBUG cinder.volume.manager [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85846) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 12:05:06 devstack cinder-volume[85846]: INFO cinder.volume.manager [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 12:05:06 devstack cinder-volume[85846]: WARNING stevedore.named [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 12:05:06 devstack cinder-volume[85846]: WARNING castellan.key_manager [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:05:06 devstack cinder-volume[85846]: WARNING cinder.keymgr.conf_key_mgr [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:05:06 devstack cinder-volume[85846]: INFO cinder.volume.manager [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 12:05:06 devstack cinder-volume[85846]: DEBUG oslo_db.sqlalchemy.engines [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85846) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:07 devstack cinder-volume[85846]: INFO oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Starting 1 workers Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Started child 86107 {{(pid=85846) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Full set of CONF: {{(pid=85846) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] ******************************************************************************** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Configuration options gathered from: {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] ================================================================================ {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] allow_availability_zone_fallback = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] allow_compression_on_image_upload = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[86107]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] allowed_direct_url_schemes = [] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] api_rate_limit = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] auth_strategy = keystone {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_availability_zone = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_host = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_name = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_stats_polling_interval = 60 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backup_api_class = cinder.backup.api.API {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backup_name_template = backup-%s {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backup_use_same_host = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backup_use_temp_snapshot = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] chap_password = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] chap_username = {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cinder_internal_tenant_project_id = 6bea78bfb53c4a1ea3d8e1c78f2591d2 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cinder_internal_tenant_user_id = c61c1aefba114e6193469a8af4c56cf6 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cluster = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] compression_format = gzip {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] compute_api_class = cinder.compute.nova.API {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] config_dir = [] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] config_source = [] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] control_exchange = openstack {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] debug = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] default_availability_zone = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] default_group_type = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] default_volume_type = QuobyteHD {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] disk_geometry = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] driver_client_cert = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] driver_client_cert_key = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] driver_data_namespace = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] driver_ssl_cert_path = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] driver_ssl_cert_verify = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] driver_use_ssl = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] enable_new_services = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] enable_unsupported_driver = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] enabled_backends = ['QuobyteHD'] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] enforce_multipath_for_image_xfer = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] filter_function = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance_api_insecure = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance_api_servers = ['http://192.168.122.246/image'] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance_api_ssl_compression = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance_ca_certificates_file = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance_catalog_info = image:glance:publicURL {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance_certfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance_keyfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance_num_retries = 3 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance_request_timeout = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] goodness_function = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] graceful_shutdown_timeout = 5 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] group_api_class = cinder.group.api.API {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] host = devstack {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] image_compress_on_upload = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] image_conversion_address_space_limit = 1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] image_conversion_cpu_limit = 60 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] image_conversion_disable = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] image_upload_use_cinder_backend = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] image_upload_use_internal_tenant = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] image_volume_cache_enabled = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] image_volume_cache_max_count = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] image_volume_cache_max_size_gb = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] init_host_max_objects_retrieval = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] instance_format = [instance: %(uuid)s] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] iscsi_target_flags = {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] iscsi_write_cache = on {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] iser_helper = tgtadm {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] iser_ip_address = 192.168.122.246 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] iser_port = 3260 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] log_color = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] log_config_append = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] log_dir = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] log_file = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] log_options = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] log_rotate_interval = 1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] log_rotate_interval_type = days {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] log_rotation_type = none {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] max_age = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] max_logfile_count = 30 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] max_logfile_size_mb = 200 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] max_over_subscription_ratio = 20.0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] message_reap_interval = 86400 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] message_ttl = 2592000 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] migration_create_volume_timeout_secs = 300 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] monkey_patch = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] monkey_patch_modules = [] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] my_ip = 192.168.122.246 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] no_snapshot_gb_quota = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] num_iser_scan_tries = 3 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] num_shell_tries = 3 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] num_volume_device_scan_tries = 3 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] nvmeof_conn_info_version = 1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] nvmet_ns_id = 10 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] nvmet_port_id = 1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] osapi_max_limit = 1000 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] osapi_volume_ext_list = [] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] osapi_volume_listen_port = 8776 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] osapi_volume_use_ssl = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] osapi_volume_workers = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] per_volume_size_limit = -1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] periodic_fuzzy_delay = 60 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] periodic_interval = 60 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] public_endpoint = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] publish_errors = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] quota_backup_gigabytes = 1000 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] quota_backups = 10 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] quota_gigabytes = 1000 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] quota_groups = 10 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] quota_snapshots = 10 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] quota_volumes = 10 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] rate_limit_burst = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] rate_limit_except_level = CRITICAL {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] rate_limit_interval = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] reinit_driver_count = 3 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] replication_device = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] report_discard_supported = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] report_interval = 120 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] reservation_clean_interval = 86400 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] reservation_expire = 86400 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] reserved_image_namespaces = [] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] reserved_percentage = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] rpc_response_timeout = 120 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] run_external_periodic_tasks = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] scst_target_driver = iscsi {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] scst_target_iqn_name = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] service_down_time = 720 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] shell_completion = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] snapshot_name_template = snapshot-%s {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] split_loggers = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] state_path = /opt/stack/data/cinder {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[86107]: INFO cinder.volume.manager [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 12:05:07 devstack cinder-volume[86107]: DEBUG cinder.volume.drivers.remotefs [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86107) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] storage_availability_zone = nova {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] storage_protocol = iSCSI {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] syslog_log_facility = LOG_USER {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] target_helper = lioadm {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] target_ip_address = 192.168.122.246 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] target_port = 3260 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] target_protocol = iscsi {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] target_secondary_ip_addresses = [] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] trace_flags = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] transport_url = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] until_refresh = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] use_chap_auth = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] use_default_quota_class = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] use_journal = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] use_json = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] use_multipath_for_image_xfer = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] use_stderr = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] use_syslog = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] verify_glance_signatures = enabled {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] volume_api_class = cinder.volume.api.API {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] volume_backend_name = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] volume_clear = zero {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] volume_clear_ionice = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] volume_clear_size = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] volume_copy_bps_limit = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] volume_dd_blocksize = 1M {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] volume_name_template = volume-%s {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] volume_service_inithost_offload = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] volume_usage_audit_period = month {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] zoning_mode = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_concurrency.disable_process_locking = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.auth_section = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.auth_type = password {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.auth_version = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.cache = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.certfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.include_service_catalog = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.insecure = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.interface = public {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.keyfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_password = {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcache_username = {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.region_name = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.service_type = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.246/identity {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.backend = dogpile.cache.null {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.backend_argument = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.backend_expiration_time = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.config_prefix = cache.oslo {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.debug_cache_backend = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.enable_retry_client = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.enable_socket_keepalive = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.enabled = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.expiration_time = 600 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.hashclient_retry_attempts = 2 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.memcache_dead_retry = 300 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.memcache_pool_maxsize = 10 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.memcache_sasl_enabled = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.password = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.proxies = [] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.redis_db = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.redis_server = localhost:6379 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.retry_attempts = 2 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.retry_delay = 0.0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.socket_keepalive_count = 1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.socket_keepalive_idle = 1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.socket_keepalive_interval = 1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.socket_timeout = 1.0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.tls_allowed_ciphers = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.tls_cafile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.tls_certfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.tls_enabled = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.tls_keyfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cache.username = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] coordination.backend_url = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.asyncio_connection = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.asyncio_slave_connection = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.backend = sqlalchemy {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.connection = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.connection_debug = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.connection_parameters = {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.connection_recycle_time = 3600 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.connection_trace = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.db_inc_retry_interval = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.db_max_retries = 20 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.db_max_retry_interval = 10 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.db_retry_interval = 1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.max_overflow = 50 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.max_pool_size = 5 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.max_retries = 10 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.mysql_wsrep_sync_wait = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.pool_timeout = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.retry_interval = 10 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.slave_connection = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.sqlite_synchronous = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.synchronous_reader = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] database.use_db_reconnect = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] profiler.connection_string = messaging:// {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] profiler.enabled = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] profiler.es_doc_type = notification {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] profiler.es_scroll_size = 10000 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] profiler.es_scroll_time = 2m {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] profiler.filter_error_trace = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] profiler.hmac_keys = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] profiler.sentinel_service_name = mymaster {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] profiler.socket_timeout = 0.1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] profiler.trace_requests = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] profiler.trace_sqlalchemy = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] profiler_jaeger.process_tags = {} {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] profiler_jaeger.service_name_prefix = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] profiler_otlp.service_name_prefix = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_policy.enforce_new_defaults = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_policy.enforce_scope = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_policy.policy_default_rule = default {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_policy.policy_file = policy.yaml {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] privsep_osbrick.group = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] privsep_osbrick.helper_command = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] privsep_osbrick.user = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cinder_sys_admin.group = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cinder_sys_admin.helper_command = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] cinder_sys_admin.user = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] service_user.auth_section = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] service_user.auth_type = password {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] service_user.cafile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] service_user.certfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] service_user.collect_timing = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] service_user.insecure = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] service_user.keyfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] service_user.send_service_user_token = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] service_user.split_loggers = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] service_user.timeout = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance.auth_section = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance.auth_type = password {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance.certfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance.collect_timing = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance.insecure = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance.keyfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance.region_name = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance.split_loggers = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] glance.timeout = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.backend_availability_zone = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.chap_password = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.chap_username = {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.disk_geometry = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.driver_client_cert = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.driver_client_cert_key = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.driver_data_namespace = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.driver_use_ssl = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.extra_capabilities = {} {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.filter_function = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.goodness_function = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.iscsi_target_flags = {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.iscsi_write_cache = on {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.iser_helper = tgtadm {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.iser_ip_address = 192.168.122.246 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.iser_port = 3260 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.nas_host = {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.nas_login = admin {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.nas_mount_options = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.nas_password = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.nas_private_key = {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.nas_share_path = {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.num_shell_tries = 3 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.quobyte_volume_url = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.replication_device = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.report_discard_supported = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.reserved_percentage = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.target_helper = tgtadm {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.target_ip_address = 192.168.122.246 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.target_port = 3260 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.target_protocol = iscsi {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.trace_flags = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.unique_fqdn_network = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.use_chap_auth = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.volume_backend_name = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.volume_clear = zero {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.volume_clear_ionice = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.volume_clear_size = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_reports.file_event_handler = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_reports.log_dir = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.backend_availability_zone = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.backend_host = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.chap_password = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.chap_username = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.chiscsi_conf = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.disk_geometry = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.driver_client_cert = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.driver_data_namespace = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.driver_use_ssl = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.extra_capabilities = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.filter_function = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.goodness_function = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.iser_helper = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.iser_ip_address = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.iser_port = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.iser_target_prefix = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.nas_host = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.nas_login = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.nas_mount_options = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.nas_password = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.nas_private_key = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.nas_share_path = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.nas_ssh_port = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.num_shell_tries = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.nvmet_port_id = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.replication_device = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.report_discard_supported = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.reserved_percentage = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.scst_target_driver = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.storage_protocol = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.target_helper = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.target_ip_address = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.target_port = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.target_prefix = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.target_protocol = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.trace_flags = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.use_chap_auth = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.volume_clear = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.volume_clear_size = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] QuobyteHD.volumes_dir = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.ssl = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_notifications.driver = [] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_notifications.retry = -1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] key_manager.fixed_key = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.barbican_api_version = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.barbican_endpoint = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.barbican_endpoint_type = public {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.barbican_region_name = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.cafile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.certfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.collect_timing = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.insecure = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.keyfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.number_of_retries = 60 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.retry_delay = 1 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.send_service_user_token = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.split_loggers = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.timeout = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.verify_ssl = True {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican.verify_ssl_path = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican_service_user.auth_section = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican_service_user.auth_type = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican_service_user.cafile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican_service_user.certfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican_service_user.collect_timing = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican_service_user.insecure = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican_service_user.keyfile = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican_service_user.split_loggers = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] barbican_service_user.timeout = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] vault.approle_role_id = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] vault.approle_secret_id = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] vault.kv_mountpoint = secret {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] vault.kv_path = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] vault.kv_version = 2 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] vault.namespace = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] vault.root_token_id = **** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] vault.ssl_ca_crt_file = None {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] vault.timeout = 60.0 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] vault.use_ssl = False {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:07 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] ******************************************************************************** {{(pid=85846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 12:05:07 devstack cinder-volume[86107]: DEBUG cinder.volume.drivers.quobyte [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86107) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 12:05:07 devstack cinder-volume[86107]: WARNING cinder.volume.drivers.quobyte [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 12:05:07 devstack cinder-volume[86107]: WARNING cinder.volume.drivers.quobyte [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 12:05:07 devstack cinder-volume[86107]: DEBUG oslo_concurrency.processutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Running cmd (subprocess): mount.quobyte {{(pid=86107) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:07 devstack quobyte-client[86119]: Reading configuration file: /etc/quobyte/client.cfg Jul 06 12:05:07 devstack quobyte-client[86119]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 06 12:05:07 devstack cinder-volume[86107]: DEBUG oslo_concurrency.processutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:07 devstack cinder-volume[86107]: DEBUG oslo_concurrency.lockutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86107) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:05:07 devstack cinder-volume[86107]: DEBUG oslo_concurrency.lockutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86107) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:05:07 devstack cinder-volume[86107]: DEBUG cinder.volume.drivers.quobyte [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86107) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:05:07 devstack cinder-volume[86107]: INFO cinder.volume.drivers.quobyte [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a ... Jul 06 12:05:07 devstack cinder-volume[86107]: DEBUG oslo_concurrency.processutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 -c /etc/quobyte/client-cinder.cfg {{(pid=86107) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:07 devstack sudo[86120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 -c /etc/quobyte/client-cinder.cfg Jul 06 12:05:07 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:08 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:08 devstack cinder-volume[86107]: DEBUG oslo_concurrency.processutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.866s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:08 devstack cinder-volume[86107]: INFO cinder.volume.drivers.quobyte [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a succeeded Jul 06 12:05:08 devstack cinder-volume[86107]: DEBUG cinder.volume.drivers.quobyte [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86107) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:05:08 devstack cinder-volume[86107]: DEBUG oslo_concurrency.lockutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.884s {{(pid=86107) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:05:08 devstack cinder-volume[86107]: DEBUG oslo_concurrency.processutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:08 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:05:08 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:09 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:09 devstack cinder-volume[86107]: DEBUG oslo_concurrency.processutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.730s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:09 devstack cinder-volume[86107]: INFO cinder.volume.driver [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Driver hasn't implemented _init_vendor_properties() Jul 06 12:05:09 devstack cinder-volume[86107]: DEBUG cinder.volume.driver [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7533416748047, 'free_capacity_gb': 1775.7533416748047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86107) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 12:05:09 devstack cinder-volume[86107]: DEBUG oslo_db.sqlalchemy.engines [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86107) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:09 devstack cinder-volume[86107]: DEBUG dbcounter [-] [86107] Writer thread running {{(pid=86107) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:05:09 devstack cinder-volume[86107]: DEBUG cinder.db.api [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Building query based on filter {{(pid=86107) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 12:05:09 devstack cinder-volume[86107]: DEBUG cinder.image.image_utils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86107) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 12:05:09 devstack cinder-volume[86107]: INFO cinder.keymgr.migration [None req-5fc1da98-39ce-4f0a-ba0b-97441deba5f0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 12:05:09 devstack cinder-volume[86107]: DEBUG oslo_concurrency.lockutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86107) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:05:09 devstack cinder-volume[86107]: DEBUG oslo_concurrency.lockutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86107) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:05:09 devstack cinder-volume[86107]: DEBUG cinder.volume.drivers.quobyte [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86107) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:05:09 devstack cinder-volume[86107]: DEBUG cinder.volume.drivers.quobyte [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86107) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:05:09 devstack cinder-volume[86107]: DEBUG oslo_concurrency.lockutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86107) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:05:09 devstack cinder-volume[86107]: DEBUG oslo_concurrency.processutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:09 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:05:09 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:10 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:10 devstack cinder-volume[86107]: DEBUG oslo_concurrency.processutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.989s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:10 devstack cinder-volume[86107]: DEBUG cinder.manager [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Notifying Schedulers of capabilities ... {{(pid=86107) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:05:10 devstack cinder-volume[86107]: INFO cinder.volume.manager [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Driver initialization completed successfully. Jul 06 12:05:10 devstack cinder-volume[86107]: INFO cinder.manager [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Initiating service 3 cleanup Jul 06 12:05:10 devstack cinder-volume[86107]: INFO cinder.manager [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Service 3 cleanup completed. Jul 06 12:05:10 devstack cinder-volume[86107]: DEBUG cinder.service [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Creating RPC server for service cinder-volume {{(pid=86107) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 12:05:10 devstack cinder-volume[86107]: DEBUG cinder.service [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86107) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 12:05:10 devstack cinder-volume[86107]: INFO cinder.volume.manager [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 12:05:10 devstack cinder-volume[86107]: DEBUG oslo_concurrency.lockutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86107) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:05:10 devstack cinder-volume[86107]: DEBUG oslo_concurrency.lockutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86107) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:05:10 devstack cinder-volume[86107]: DEBUG cinder.volume.drivers.quobyte [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86107) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:05:10 devstack cinder-volume[86107]: DEBUG cinder.volume.drivers.quobyte [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86107) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:05:10 devstack cinder-volume[86107]: DEBUG oslo_concurrency.lockutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86107) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:05:10 devstack cinder-volume[86107]: DEBUG oslo_concurrency.processutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:10 devstack sudo[86351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:05:10 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:11 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:11 devstack cinder-volume[86107]: DEBUG oslo_concurrency.processutils [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.896s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:11 devstack cinder-volume[86107]: INFO cinder.volume.manager [None req-539735d1-c9f8-429f-a8ad-b14bb431fe59 None None] Driver post RPC initialization completed successfully. Jul 06 12:05:14 devstack cinder-volume[86107]: DEBUG oslo_concurrency.lockutils [None req-9d959a01-aa9b-4216-b349-8f7716f26ffb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86107) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:05:14 devstack cinder-volume[86107]: DEBUG oslo_concurrency.lockutils [None req-9d959a01-aa9b-4216-b349-8f7716f26ffb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86107) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:05:14 devstack cinder-volume[86107]: DEBUG cinder.volume.drivers.quobyte [None req-9d959a01-aa9b-4216-b349-8f7716f26ffb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86107) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:05:14 devstack cinder-volume[86107]: DEBUG cinder.volume.drivers.quobyte [None req-9d959a01-aa9b-4216-b349-8f7716f26ffb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86107) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:05:14 devstack cinder-volume[86107]: DEBUG oslo_concurrency.lockutils [None req-9d959a01-aa9b-4216-b349-8f7716f26ffb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86107) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:05:14 devstack cinder-volume[86107]: DEBUG oslo_concurrency.processutils [None req-9d959a01-aa9b-4216-b349-8f7716f26ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:14 devstack sudo[86392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:05:14 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:14 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:14 devstack cinder-volume[86107]: DEBUG oslo_concurrency.processutils [None req-9d959a01-aa9b-4216-b349-8f7716f26ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.657s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:14 devstack cinder-volume[86107]: DEBUG cinder.manager [None req-9d959a01-aa9b-4216-b349-8f7716f26ffb None None] Notifying Schedulers of capabilities ... {{(pid=86107) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:05:15 devstack cinder-volume[85846]: INFO oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Caught SIGTERM, stopping children Jul 06 12:05:15 devstack cinder-volume[85846]: DEBUG oslo_concurrency.lockutils [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Acquiring lock "singleton_lock" {{(pid=85846) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:05:15 devstack cinder-volume[85846]: DEBUG oslo_concurrency.lockutils [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Acquired lock "singleton_lock" {{(pid=85846) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:05:15 devstack cinder-volume[85846]: DEBUG oslo_concurrency.lockutils [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Releasing lock "singleton_lock" {{(pid=85846) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:05:15 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Stop services. {{(pid=85846) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 12:05:15 devstack cinder-volume[85846]: DEBUG oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Killing children. {{(pid=85846) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 12:05:15 devstack cinder-volume[85846]: INFO oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Waiting on 1 children to exit Jul 06 12:05:18 devstack cinder-volume[86107]: DEBUG oslo_concurrency.lockutils [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Acquiring lock "singleton_lock" {{(pid=86107) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:05:18 devstack cinder-volume[86107]: DEBUG oslo_concurrency.lockutils [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Acquired lock "singleton_lock" {{(pid=86107) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:05:18 devstack cinder-volume[86107]: DEBUG oslo_concurrency.lockutils [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Releasing lock "singleton_lock" {{(pid=86107) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:05:18 devstack cinder-volume[86107]: WARNING amqp [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 12:05:18 devstack cinder-volume[86107]: WARNING amqp [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 12:05:18 devstack cinder-volume[85846]: INFO oslo_service.backend._eventlet.service [None req-b94cdab7-ce86-4908-9df9-70f6416d9954 None None] Child 86107 exited with status 0 Jul 06 12:05:19 devstack cinder-volume[86476]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 12:05:19 devstack cinder-volume[86476]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 12:05:19 devstack cinder-volume[86476]: we strongly recommend against using it for new projects. Jul 06 12:05:19 devstack cinder-volume[86476]: If you are already using Eventlet, we recommend migrating to a different Jul 06 12:05:19 devstack cinder-volume[86476]: framework. For more detail see Jul 06 12:05:19 devstack cinder-volume[86476]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 12:05:19 devstack cinder-volume[86476]: import eventlet # noqa Jul 06 12:05:22 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:05:22 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:05:22 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:05:23 devstack cinder-volume[86476]: INFO dbcounter [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] Registered counter for database cinder Jul 06 12:05:23 devstack cinder-volume[86476]: DEBUG oslo_db.sqlalchemy.engines [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86476) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:23 devstack cinder-volume[86476]: DEBUG dbcounter [-] [86476] Writer thread running {{(pid=86476) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:05:23 devstack cinder-volume[86476]: INFO cinder.rpc [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 12:05:23 devstack cinder-volume[86476]: INFO cinder.rpc [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 12:05:23 devstack cinder-volume[86476]: DEBUG oslo_db.sqlalchemy.engines [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86476) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:23 devstack cinder-volume[86476]: INFO cinder.volume.manager [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] Determined volume DB was empty at startup. Jul 06 12:05:23 devstack cinder-volume[86476]: DEBUG cinder.volume.manager [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86476) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 12:05:23 devstack cinder-volume[86476]: WARNING stevedore.named [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 12:05:23 devstack cinder-volume[86476]: WARNING castellan.key_manager [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:05:23 devstack cinder-volume[86476]: WARNING cinder.keymgr.conf_key_mgr [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:05:23 devstack cinder-volume[86476]: INFO cinder.volume.manager [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_db.sqlalchemy.engines [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86476) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:24 devstack cinder-volume[86476]: INFO oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] Starting 1 workers Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] Started child 86761 {{(pid=86476) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] Full set of CONF: {{(pid=86476) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] ******************************************************************************** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] Configuration options gathered from: {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] ================================================================================ {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 12:05:24 devstack cinder-volume[86761]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] allow_availability_zone_fallback = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] allow_compression_on_image_upload = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] allowed_direct_url_schemes = [] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] api_rate_limit = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] auth_strategy = keystone {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_availability_zone = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_host = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_name = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_stats_polling_interval = 60 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backup_api_class = cinder.backup.api.API {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backup_name_template = backup-%s {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backup_use_same_host = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backup_use_temp_snapshot = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] chap_password = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] chap_username = {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cinder_internal_tenant_project_id = 6bea78bfb53c4a1ea3d8e1c78f2591d2 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cinder_internal_tenant_user_id = c61c1aefba114e6193469a8af4c56cf6 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cluster = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] compression_format = gzip {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] compute_api_class = cinder.compute.nova.API {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] config_dir = [] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] config_source = [] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] control_exchange = openstack {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] debug = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] default_availability_zone = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] default_group_type = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] default_volume_type = QuobyteHD {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] disk_geometry = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] driver_client_cert = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] driver_client_cert_key = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] driver_data_namespace = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] driver_ssl_cert_path = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] driver_ssl_cert_verify = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] driver_use_ssl = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] enable_new_services = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] enable_unsupported_driver = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] enabled_backends = ['QuobyteHD'] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] enforce_multipath_for_image_xfer = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] filter_function = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance_api_insecure = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance_api_servers = ['http://192.168.122.246/image'] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance_api_ssl_compression = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance_ca_certificates_file = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance_catalog_info = image:glance:publicURL {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance_certfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance_keyfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance_num_retries = 3 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance_request_timeout = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] goodness_function = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] graceful_shutdown_timeout = 5 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] group_api_class = cinder.group.api.API {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] host = devstack {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] image_compress_on_upload = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] image_conversion_address_space_limit = 1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] image_conversion_cpu_limit = 60 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] image_conversion_disable = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] image_upload_use_cinder_backend = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] image_upload_use_internal_tenant = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] image_volume_cache_enabled = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] image_volume_cache_max_count = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] image_volume_cache_max_size_gb = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] init_host_max_objects_retrieval = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] instance_format = [instance: %(uuid)s] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] iscsi_target_flags = {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] iscsi_write_cache = on {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] iser_helper = tgtadm {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] iser_ip_address = 192.168.122.246 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] iser_port = 3260 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] log_color = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] log_config_append = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] log_dir = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] log_file = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] log_options = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] log_rotate_interval = 1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] log_rotate_interval_type = days {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] log_rotation_type = none {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] max_age = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] max_logfile_count = 30 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] max_logfile_size_mb = 200 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] max_over_subscription_ratio = 20.0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] message_reap_interval = 86400 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] message_ttl = 2592000 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86761) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] migration_create_volume_timeout_secs = 300 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] monkey_patch = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] monkey_patch_modules = [] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] my_ip = 192.168.122.246 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] no_snapshot_gb_quota = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] num_iser_scan_tries = 3 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] num_shell_tries = 3 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] num_volume_device_scan_tries = 3 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] nvmeof_conn_info_version = 1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] nvmet_ns_id = 10 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] nvmet_port_id = 1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] osapi_max_limit = 1000 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] osapi_volume_ext_list = [] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] osapi_volume_listen_port = 8776 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] osapi_volume_use_ssl = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] osapi_volume_workers = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] per_volume_size_limit = -1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] periodic_fuzzy_delay = 60 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] periodic_interval = 60 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] public_endpoint = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] publish_errors = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] quota_backup_gigabytes = 1000 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] quota_backups = 10 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] quota_gigabytes = 1000 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] quota_groups = 10 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] quota_snapshots = 10 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] quota_volumes = 10 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] rate_limit_burst = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] rate_limit_except_level = CRITICAL {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] rate_limit_interval = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] reinit_driver_count = 3 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] replication_device = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] report_discard_supported = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] report_interval = 120 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] reservation_clean_interval = 86400 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] reservation_expire = 86400 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] reserved_image_namespaces = [] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] reserved_percentage = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] rpc_response_timeout = 120 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] run_external_periodic_tasks = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] scst_target_driver = iscsi {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] scst_target_iqn_name = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] service_down_time = 720 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] shell_completion = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] snapshot_name_template = snapshot-%s {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] split_loggers = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] state_path = /opt/stack/data/cinder {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] storage_availability_zone = nova {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] storage_protocol = iSCSI {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] syslog_log_facility = LOG_USER {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] target_helper = lioadm {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] target_ip_address = 192.168.122.246 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] target_port = 3260 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] target_protocol = iscsi {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] target_secondary_ip_addresses = [] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] trace_flags = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] transport_url = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] until_refresh = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] use_chap_auth = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] use_default_quota_class = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] use_journal = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] use_json = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] use_multipath_for_image_xfer = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] use_stderr = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] use_syslog = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] verify_glance_signatures = enabled {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] volume_api_class = cinder.volume.api.API {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] volume_backend_name = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] volume_clear = zero {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] volume_clear_ionice = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] volume_clear_size = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] volume_copy_bps_limit = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] volume_dd_blocksize = 1M {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] volume_name_template = volume-%s {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] volume_service_inithost_offload = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] volume_usage_audit_period = month {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] zoning_mode = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_concurrency.disable_process_locking = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.auth_section = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.auth_type = password {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.auth_version = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.cache = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.certfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.include_service_catalog = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.insecure = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.interface = public {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.keyfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_password = {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcache_username = {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.region_name = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.service_type = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.246/identity {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.backend = dogpile.cache.null {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.backend_argument = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.backend_expiration_time = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.config_prefix = cache.oslo {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.debug_cache_backend = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.enable_retry_client = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.enable_socket_keepalive = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.enabled = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.expiration_time = 600 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.hashclient_retry_attempts = 2 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.memcache_dead_retry = 300 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.memcache_pool_maxsize = 10 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.memcache_sasl_enabled = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.password = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.proxies = [] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.redis_db = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.redis_server = localhost:6379 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.retry_attempts = 2 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.retry_delay = 0.0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.socket_keepalive_count = 1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.socket_keepalive_idle = 1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.socket_keepalive_interval = 1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.socket_timeout = 1.0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.tls_allowed_ciphers = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.tls_cafile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.tls_certfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.tls_enabled = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.tls_keyfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cache.username = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] coordination.backend_url = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.asyncio_connection = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.asyncio_slave_connection = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.backend = sqlalchemy {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.connection = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.connection_debug = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.connection_parameters = {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.connection_recycle_time = 3600 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.connection_trace = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.db_inc_retry_interval = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.db_max_retries = 20 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.db_max_retry_interval = 10 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.db_retry_interval = 1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.max_overflow = 50 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.max_pool_size = 5 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.max_retries = 10 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.mysql_wsrep_sync_wait = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.pool_timeout = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.retry_interval = 10 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.slave_connection = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.sqlite_synchronous = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.synchronous_reader = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] database.use_db_reconnect = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] profiler.connection_string = messaging:// {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] profiler.enabled = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] profiler.es_doc_type = notification {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] profiler.es_scroll_size = 10000 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] profiler.es_scroll_time = 2m {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] profiler.filter_error_trace = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] profiler.hmac_keys = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] profiler.sentinel_service_name = mymaster {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] profiler.socket_timeout = 0.1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] profiler.trace_requests = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] profiler.trace_sqlalchemy = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] profiler_jaeger.process_tags = {} {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] profiler_jaeger.service_name_prefix = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86761) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 12:05:24 devstack quobyte-client[86762]: Reading configuration file: /etc/quobyte/client.cfg Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] profiler_otlp.service_name_prefix = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_policy.enforce_new_defaults = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_policy.enforce_scope = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack quobyte-client[86762]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 06 12:05:24 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.quobyte [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_policy.policy_default_rule = default {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.quobyte [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_policy.policy_file = policy.yaml {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Running cmd (subprocess): mount.quobyte {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] privsep_osbrick.group = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] privsep_osbrick.helper_command = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] privsep_osbrick.user = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cinder_sys_admin.group = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cinder_sys_admin.helper_command = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] cinder_sys_admin.user = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] service_user.auth_section = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] service_user.auth_type = password {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] service_user.cafile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] service_user.certfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] service_user.collect_timing = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] service_user.insecure = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] service_user.keyfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] service_user.send_service_user_token = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] service_user.split_loggers = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] service_user.timeout = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance.auth_section = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance.auth_type = password {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance.certfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance.collect_timing = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance.insecure = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance.keyfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance.region_name = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance.split_loggers = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] glance.timeout = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.backend_availability_zone = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.chap_password = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.chap_username = {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.disk_geometry = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.driver_client_cert = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.driver_client_cert_key = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.driver_data_namespace = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.driver_use_ssl = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.extra_capabilities = {} {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.filter_function = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.goodness_function = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.iscsi_target_flags = {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.iscsi_write_cache = on {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.iser_helper = tgtadm {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.iser_ip_address = 192.168.122.246 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.iser_port = 3260 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.nas_host = {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.nas_login = admin {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.nas_mount_options = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.nas_password = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.nas_private_key = {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.nas_share_path = {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.num_shell_tries = 3 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.quobyte_volume_url = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.replication_device = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.report_discard_supported = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.reserved_percentage = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.target_helper = tgtadm {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.target_ip_address = 192.168.122.246 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.target_port = 3260 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.target_protocol = iscsi {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.trace_flags = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.unique_fqdn_network = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.use_chap_auth = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.volume_backend_name = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.volume_clear = zero {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.volume_clear_ionice = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.volume_clear_size = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_reports.file_event_handler = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_reports.log_dir = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.backend_availability_zone = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.backend_host = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.chap_password = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.chap_username = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.chiscsi_conf = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.disk_geometry = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.driver_client_cert = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.driver_data_namespace = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.driver_use_ssl = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.extra_capabilities = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.filter_function = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.goodness_function = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.iser_helper = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.iser_ip_address = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.iser_port = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.iser_target_prefix = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.nas_host = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.nas_login = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.nas_mount_options = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.nas_password = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.nas_private_key = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.nas_share_path = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.nas_ssh_port = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.num_shell_tries = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.nvmet_port_id = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.replication_device = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.report_discard_supported = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.reserved_percentage = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.scst_target_driver = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.storage_protocol = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.target_helper = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.target_ip_address = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.target_port = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.target_prefix = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.target_protocol = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.trace_flags = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.use_chap_auth = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.volume_clear = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.volume_clear_size = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] QuobyteHD.volumes_dir = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.ssl = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_notifications.driver = [] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_notifications.retry = -1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] key_manager.fixed_key = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.barbican_api_version = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.barbican_endpoint = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.barbican_endpoint_type = public {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.barbican_region_name = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.cafile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.certfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.collect_timing = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.insecure = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.keyfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.number_of_retries = 60 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.retry_delay = 1 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.send_service_user_token = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.split_loggers = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.timeout = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.verify_ssl = True {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican.verify_ssl_path = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican_service_user.auth_section = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican_service_user.auth_type = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican_service_user.cafile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican_service_user.certfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican_service_user.collect_timing = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican_service_user.insecure = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican_service_user.keyfile = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican_service_user.split_loggers = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] barbican_service_user.timeout = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] vault.approle_role_id = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] vault.approle_secret_id = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] vault.kv_mountpoint = secret {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] vault.kv_path = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] vault.kv_version = 2 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] vault.namespace = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] vault.root_token_id = **** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] vault.ssl_ca_crt_file = None {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] vault.timeout = 60.0 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] vault.use_ssl = False {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:24 devstack cinder-volume[86476]: DEBUG oslo_service.backend._eventlet.service [None req-0a90cdd0-7fa3-4d33-b7fc-dbac2a9baa26 None None] ******************************************************************************** {{(pid=86476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 12:05:24 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.636s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:24 devstack cinder-volume[86761]: INFO cinder.volume.driver [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Driver hasn't implemented _init_vendor_properties() Jul 06 12:05:24 devstack cinder-volume[86761]: DEBUG cinder.volume.driver [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7533416748047, 'free_capacity_gb': 1775.7533416748047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86761) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 12:05:24 devstack cinder-volume[86761]: DEBUG oslo_db.sqlalchemy.engines [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86761) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writer thread running {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG cinder.db.api [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Building query based on filter {{(pid=86761) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86761) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:25 devstack cinder-volume[86761]: INFO cinder.keymgr.migration [None req-7759051b-d3c4-44ff-a3fa-dd37453bc019 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 12:05:25 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:05:25 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:25 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.658s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:05:25 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Driver initialization completed successfully. Jul 06 12:05:25 devstack cinder-volume[86761]: INFO cinder.manager [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Initiating service 3 cleanup Jul 06 12:05:25 devstack cinder-volume[86761]: INFO cinder.manager [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Service 3 cleanup completed. Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG cinder.service [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Creating RPC server for service cinder-volume {{(pid=86761) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG cinder.service [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86761) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 12:05:25 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:05:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:25 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:05:25 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:26 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.628s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:26 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-af072e4f-6f88-49a8-8106-ed3b7dd4cfbb None None] Driver post RPC initialization completed successfully. Jul 06 12:05:34 devstack cinder-volume[86476]: DEBUG dbcounter [-] [86476] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86476) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:05:35 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=3 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:05:36 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:05:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:05:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 6 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:05:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Flow 'volume_create_manager' (1988f576-e506-4bff-b0fb-f7e9d73cc620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b5f735-399b-4eed-b2cf-92f91840df37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b5f735-399b-4eed-b2cf-92f91840df37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1989766216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdfd1b98-ca79-4fc7-bf09-0177a72020f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d6eb3603044c94a46018b3752e1cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:06:48Z,use_quota=True,user_id='1127e039d97943a3938889a945cf5289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f294b9-ab06-4d15-b842-3faba9e0987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f294b9-ab06-4d15-b842-3faba9e0987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbde976-3069-41b3-a64c-e55a8ff32e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbde976-3069-41b3-a64c-e55a8ff32e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdfd1b98-ca79-4fc7-bf09-0177a72020f5', 'volume_name': 'volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90911d5-919a-4bed-a0f6-4e6564fbe065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90911d5-919a-4bed-a0f6-4e6564fbe065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3788bd37-72d0-4abc-be9c-715bc833d51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:48 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Volume bdfd1b98-ca79-4fc7-bf09-0177a72020f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5', 'volume_size': 1} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1989766216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdfd1b98-ca79-4fc7-bf09-0177a72020f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d6eb3603044c94a46018b3752e1cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:06:48Z,use_quota=True,user_id='1127e039d97943a3938889a945cf5289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Creating volume bdfd1b98-ca79-4fc7-bf09-0177a72020f5 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:06:48 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:06:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:48 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5 1073741824 Jul 06 12:06:48 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:51 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5 1073741824" returned: 0 in 3.112s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:52 devstack sudo[87699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5 Jul 06 12:06:52 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:06:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:06:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:06:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:06:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:06:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:06:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:52 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:06:52 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:54 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.650s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:54 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:06:54 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:06:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 6 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:06:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:06:54 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5" returned: 0 in 2.510s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] <== create_volume: return (5881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:06:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.894s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:06:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3788bd37-72d0-4abc-be9c-715bc833d51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e95ae2-0a01-47e2-b0a5-0d0eb8c08716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:54 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Volume volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5 (bdfd1b98-ca79-4fc7-bf09-0177a72020f5): created successfully Jul 06 12:06:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e95ae2-0a01-47e2-b0a5-0d0eb8c08716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Flow 'volume_create_manager' (1988f576-e506-4bff-b0fb-f7e9d73cc620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:06:54 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6dd9ac85-2740-4d5f-89eb-12c3bdacb5e7 tempest-DeleteServersTestJSON-1700793729 None] Created volume successfully. Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Flow 'volume_create_manager' (75a77020-814d-42fe-9d36-80108219085b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a7d5b6-8360-4ce2-a6f9-ddf16edea1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a7d5b6-8360-4ce2-a6f9-ddf16edea1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1195578143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3437165-7649-45fb-b494-f939818059de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56045ff9a1f4b609e2906525723aadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:06:57Z,use_quota=True,user_id='d231ed2efe0e4ebdbd5258eec98bbe1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ad957b-cc05-4e40-99e2-0d93e8b0cc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ad957b-cc05-4e40-99e2-0d93e8b0cc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f7f5a9-02de-42c4-8f78-e22d566cfc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f7f5a9-02de-42c4-8f78-e22d566cfc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3437165-7649-45fb-b494-f939818059de', 'volume_name': 'volume-d3437165-7649-45fb-b494-f939818059de', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b150a069-477f-4113-bea9-aff7273b179d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b150a069-477f-4113-bea9-aff7273b179d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be31038-3a63-487e-98be-054cd5e79326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:56 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Volume d3437165-7649-45fb-b494-f939818059de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3437165-7649-45fb-b494-f939818059de', 'volume_size': 1} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1195578143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3437165-7649-45fb-b494-f939818059de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56045ff9a1f4b609e2906525723aadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:06:57Z,use_quota=True,user_id='d231ed2efe0e4ebdbd5258eec98bbe1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Creating volume d3437165-7649-45fb-b494-f939818059de {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:06:56 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:06:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d3437165-7649-45fb-b494-f939818059de 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:56 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d3437165-7649-45fb-b494-f939818059de 1073741824 Jul 06 12:06:56 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:59 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d3437165-7649-45fb-b494-f939818059de 1073741824" returned: 0 in 2.124s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d3437165-7649-45fb-b494-f939818059de {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:59 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d3437165-7649-45fb-b494-f939818059de Jul 06 12:06:59 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:01 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d3437165-7649-45fb-b494-f939818059de" returned: 0 in 1.900s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] <== create_volume: return (4164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:07:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.178s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be31038-3a63-487e-98be-054cd5e79326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3437165-7649-45fb-b494-f939818059de', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5834ed-400b-4ca5-9e3e-f2936f013d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:01 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Volume volume-d3437165-7649-45fb-b494-f939818059de (d3437165-7649-45fb-b494-f939818059de): created successfully Jul 06 12:07:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5834ed-400b-4ca5-9e3e-f2936f013d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Flow 'volume_create_manager' (75a77020-814d-42fe-9d36-80108219085b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:07:01 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-643939b9-2f2e-438e-910d-41a4196f4edc tempest-VolumesAdminNegativeTest-933366468 None] Created volume successfully. Jul 06 12:07:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Acquiring lock "cinder-d3437165-7649-45fb-b494-f939818059de-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Lock "cinder-d3437165-7649-45fb-b494-f939818059de-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Acquiring lock "cinder-quobyte-d3437165-7649-45fb-b494-f939818059de" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Lock "cinder-quobyte-d3437165-7649-45fb-b494-f939818059de" acquired by "delete_volume" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:03 devstack cinder-volume[86761]: INFO oslo.privsep.daemon [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpn8wdbc45/privsep.sock'] Jul 06 12:07:03 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpn8wdbc45/privsep.sock Jul 06 12:07:03 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:04 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 06 12:07:04 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 12:07:04 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 12:07:04 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 12:07:04 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 12:07:04 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 12:07:04 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 12:07:04 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 12:07:04 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 06 12:07:05 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 06 12:07:05 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 12:07:05 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 12:07:05 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 12:07:05 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 12:07:05 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 12:07:05 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 12:07:05 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 12:07:05 devstack cinder-volume[86761]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 06 12:07:06 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:06 devstack cinder-volume[86761]: INFO oslo.privsep.daemon [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Spawned new privsep daemon via rootwrap Jul 06 12:07:06 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Accepted privsep connection to /tmp/tmpn8wdbc45/privsep.sock {{(pid=86761) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 06 12:07:06 devstack cinder-volume[86761]: WARNING py.warnings [req-9de8bd00-dc3b-4d98-a386-c67b20d74066 req-c9056906-6b33-4c47-9d7f-fd5f766289e8 tempest-DeleteServersTestJSON-1700793729 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 06 12:07:06 devstack cinder-volume[86761]: .first() Jul 06 12:07:06 devstack cinder-volume[86761]: Jul 06 12:07:06 devstack cinder-volume[86761]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 06 12:07:06 devstack cinder-volume[86761]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 06 12:07:06 devstack cinder-volume[86761]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 06 12:07:06 devstack cinder-volume[86761]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87831 Jul 06 12:07:06 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d7d009-9a25-4e27-8aa6-c8d5dfe7cfab]: (2,) {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:07:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-9de8bd00-dc3b-4d98-a386-c67b20d74066 req-c9056906-6b33-4c47-9d7f-fd5f766289e8 tempest-DeleteServersTestJSON-1700793729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-9de8bd00-dc3b-4d98-a386-c67b20d74066 req-c9056906-6b33-4c47-9d7f-fd5f766289e8 tempest-DeleteServersTestJSON-1700793729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:06 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3fd601-5870-4201-928d-c630c2b56b97]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:07:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-9de8bd00-dc3b-4d98-a386-c67b20d74066 req-c9056906-6b33-4c47-9d7f-fd5f766289e8 tempest-DeleteServersTestJSON-1700793729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:06 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[8686c1a5-cf29-4a0d-bc82-6cff27a732da]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:07:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d3437165-7649-45fb-b494-f939818059de {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:06 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5 Jul 06 12:07:06 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:06 devstack sudo[87840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d3437165-7649-45fb-b494-f939818059de Jul 06 12:07:06 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:07 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-9de8bd00-dc3b-4d98-a386-c67b20d74066 req-c9056906-6b33-4c47-9d7f-fd5f766289e8 tempest-DeleteServersTestJSON-1700793729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5" returned: 0 in 1.202s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-9de8bd00-dc3b-4d98-a386-c67b20d74066 req-c9056906-6b33-4c47-9d7f-fd5f766289e8 tempest-DeleteServersTestJSON-1700793729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.222s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:07 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d3437165-7649-45fb-b494-f939818059de" returned: 0 in 1.307s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d3437165-7649-45fb-b494-f939818059de {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-9de8bd00-dc3b-4d98-a386-c67b20d74066 req-c9056906-6b33-4c47-9d7f-fd5f766289e8 tempest-DeleteServersTestJSON-1700793729 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32895b74-595a-4999-a2f2-1af106505132', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:07:07 devstack sudo[87849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d3437165-7649-45fb-b494-f939818059de Jul 06 12:07:07 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:07 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-9de8bd00-dc3b-4d98-a386-c67b20d74066 req-c9056906-6b33-4c47-9d7f-fd5f766289e8 tempest-DeleteServersTestJSON-1700793729 None] attachment_update completed successfully. Jul 06 12:07:09 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d3437165-7649-45fb-b494-f939818059de" returned: 0 in 1.938s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Lock "cinder-quobyte-d3437165-7649-45fb-b494-f939818059de" released by "delete_volume" :: held 5.795s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:09 devstack cinder-volume[86761]: WARNING cinder.quota [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:07:09 devstack cinder-volume[86761]: WARNING cinder.quota [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:07:09 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Created reservations ['7ac55bf0-e829-4b35-a1f3-11a6c03ac897', '98753c93-cc88-4c05-90da-5a107812a3ae', '7d92b03c-746d-41e6-8889-becd722e0b9b', 'dbba8f1f-4c5a-4283-a910-a5f70e93e840'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:07:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:09 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:07:09 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:11 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.352s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:11 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:07:11 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Deleted volume successfully. Jul 06 12:07:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61859a26-b336-4ace-8c5c-1a14f83c2f56 tempest-VolumesAdminNegativeTest-933366468 None] Lock "cinder-d3437165-7649-45fb-b494-f939818059de-delete_volume" released by "delete_volume" :: held 7.595s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:19 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=12,cinder:UPDATE=16,cinder:INSERT=5 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:07:21 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=15,cinder:SELECT=17,cinder:DELETE=3,cinder:INSERT=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:07:22 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-242ce329-63f8-46b5-8d54-7fad8261e070 req-f6fa6ac1-a3f5-4233-afbf-6ff7fb890944 tempest-DeleteServersTestJSON-1700793729 None] Terminate volume connection completed successfully. Jul 06 12:07:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-242ce329-63f8-46b5-8d54-7fad8261e070 req-f6fa6ac1-a3f5-4233-afbf-6ff7fb890944 tempest-DeleteServersTestJSON-1700793729 None] Deleting attachment 32895b74-595a-4999-a2f2-1af106505132. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:07:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Acquiring lock "cinder-bdfd1b98-ca79-4fc7-bf09-0177a72020f5-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Lock "cinder-bdfd1b98-ca79-4fc7-bf09-0177a72020f5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Acquiring lock "cinder-quobyte-bdfd1b98-ca79-4fc7-bf09-0177a72020f5" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Lock "cinder-quobyte-bdfd1b98-ca79-4fc7-bf09-0177a72020f5" acquired by "delete_volume" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:27 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe7a726-c87b-4bfd-af41-faa914424beb]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:07:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:27 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5 Jul 06 12:07:27 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:28 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5" returned: 0 in 1.077s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:28 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5 Jul 06 12:07:28 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:29 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bdfd1b98-ca79-4fc7-bf09-0177a72020f5" returned: 0 in 1.346s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Lock "cinder-quobyte-bdfd1b98-ca79-4fc7-bf09-0177a72020f5" released by "delete_volume" :: held 2.493s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:29 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Created reservations ['18d68b11-e8ca-4691-974a-bd722a08b16c', 'd136e27e-fc75-40de-934a-129b0b97e5ae', '006a08aa-a69b-4985-aa8b-d1e0a3af59b9', '3c3deea1-afd1-4348-8d0b-5491528ec5e6'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:07:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:30 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:07:30 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:31 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.951s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:31 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:07:31 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Deleted volume successfully. Jul 06 12:07:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0ff03d96-09c1-4d30-b253-ad88f2cf1ece tempest-DeleteServersTestJSON-1700793729 None] Lock "cinder-bdfd1b98-ca79-4fc7-bf09-0177a72020f5-delete_volume" released by "delete_volume" :: held 3.768s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Flow 'volume_create_manager' (448e73fa-099b-4669-b5d2-1e46e814db51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033635da-ed64-4101-8df7-dfbe7b90c0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033635da-ed64-4101-8df7-dfbe7b90c0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1172673760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccb8ebdc01f48b2ba5932564d3f15a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:07:33Z,use_quota=True,user_id='3cc9e3848d174916a25c158e43f61398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b12a6c-df70-440c-86f8-38ff685a40ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b12a6c-df70-440c-86f8-38ff685a40ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c950eba1-13c0-44fd-855e-b7bd02496583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c950eba1-13c0-44fd-855e-b7bd02496583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd', 'volume_name': 'volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c1efa0-f7e8-4559-a8e5-cc0d9d4d94bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c1efa0-f7e8-4559-a8e5-cc0d9d4d94bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7921d1a7-a175-4dc1-abfc-53aa3ce4670d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:33 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Volume 2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd', 'volume_size': 1} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1172673760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccb8ebdc01f48b2ba5932564d3f15a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:07:33Z,use_quota=True,user_id='3cc9e3848d174916a25c158e43f61398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Creating volume 2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:07:33 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:07:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:33 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd 1073741824 Jul 06 12:07:33 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:34 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd 1073741824" returned: 0 in 1.308s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:34 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd Jul 06 12:07:34 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:35 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd" returned: 0 in 0.840s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:07:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7921d1a7-a175-4dc1-abfc-53aa3ce4670d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34089518-3b09-4cb2-8841-a7837e0b90da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:35 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Volume volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd (2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd): created successfully Jul 06 12:07:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34089518-3b09-4cb2-8841-a7837e0b90da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Flow 'volume_create_manager' (448e73fa-099b-4669-b5d2-1e46e814db51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:07:35 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-989a8b4b-bdaf-498e-90b2-6c74adcfadf9 tempest-ServersNegativeTestJSON-211598026 None] Created volume successfully. Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Flow 'volume_create_manager' (46efeb27-7563-4c8f-aa3a-4f9cafaf1a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c5e26b-70da-4257-8df5-9364d0f3d87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c5e26b-70da-4257-8df5-9364d0f3d87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-914305579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c78a10-f946-4f13-b6cd-bd68c8bd1b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7112e8be1baa43968a32fa874122ad7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:07:38Z,use_quota=True,user_id='ce37824ea2e1418883dd523eac8835f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6836a6c-5636-4706-8799-bf2fe8306a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6836a6c-5636-4706-8799-bf2fe8306a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdb1547-5ff6-4d6c-bf39-d38893cb6bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdb1547-5ff6-4d6c-bf39-d38893cb6bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33c78a10-f946-4f13-b6cd-bd68c8bd1b39', 'volume_name': 'volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3dc959-249b-47e0-9def-7a43ed4e2ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3dc959-249b-47e0-9def-7a43ed4e2ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafade50-44a5-4a95-8d39-cd6b500295b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:38 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Volume 33c78a10-f946-4f13-b6cd-bd68c8bd1b39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39', 'volume_size': 1} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-914305579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c78a10-f946-4f13-b6cd-bd68c8bd1b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7112e8be1baa43968a32fa874122ad7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:07:38Z,use_quota=True,user_id='ce37824ea2e1418883dd523eac8835f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Creating volume 33c78a10-f946-4f13-b6cd-bd68c8bd1b39 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:07:38 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:07:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:38 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39 1073741824 Jul 06 12:07:38 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:39 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:07:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Flow 'volume_create_manager' (c4d8ff73-e26a-4f1f-85dc-d3818a7fe524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:07:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12904cd8-dc01-487c-8adf-2e2122e28e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12904cd8-dc01-487c-8adf-2e2122e28e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1489741766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e869f12a-f6cf-436d-aac8-038f7211d394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccb8ebdc01f48b2ba5932564d3f15a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:07:40Z,use_quota=True,user_id='3cc9e3848d174916a25c158e43f61398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dc4690-728a-44ff-99e3-3079ab10b47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dc4690-728a-44ff-99e3-3079ab10b47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b98a34-c49b-4b95-9d7a-8635fd8c088f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b98a34-c49b-4b95-9d7a-8635fd8c088f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e869f12a-f6cf-436d-aac8-038f7211d394', 'volume_name': 'volume-e869f12a-f6cf-436d-aac8-038f7211d394', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9e81aa-ceb3-4e4f-8f19-625b6eb4b852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9e81aa-ceb3-4e4f-8f19-625b6eb4b852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb5917c-8da3-437b-bc70-747207eddc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:39 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Volume e869f12a-f6cf-436d-aac8-038f7211d394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e869f12a-f6cf-436d-aac8-038f7211d394', 'volume_size': 1} Jul 06 12:07:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:39 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39 1073741824" returned: 0 in 1.646s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:39 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39 Jul 06 12:07:39 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:40 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39" returned: 0 in 0.778s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] <== create_volume: return (2488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.490s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.950s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1489741766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e869f12a-f6cf-436d-aac8-038f7211d394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccb8ebdc01f48b2ba5932564d3f15a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:07:40Z,use_quota=True,user_id='3cc9e3848d174916a25c158e43f61398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Creating volume e869f12a-f6cf-436d-aac8-038f7211d394 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:07:40 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e869f12a-f6cf-436d-aac8-038f7211d394 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafade50-44a5-4a95-8d39-cd6b500295b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:40 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e869f12a-f6cf-436d-aac8-038f7211d394 1073741824 Jul 06 12:07:40 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a4347b-69b2-442f-8825-53309b5148fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:40 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Volume volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39 (33c78a10-f946-4f13-b6cd-bd68c8bd1b39): created successfully Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a4347b-69b2-442f-8825-53309b5148fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Flow 'volume_create_manager' (46efeb27-7563-4c8f-aa3a-4f9cafaf1a11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:07:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7cb4c09a-1125-4508-8ff5-caf156f46230 tempest-TaggedAttachmentsTest-1982372257 None] Created volume successfully. Jul 06 12:07:41 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e869f12a-f6cf-436d-aac8-038f7211d394 1073741824" returned: 0 in 1.132s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e869f12a-f6cf-436d-aac8-038f7211d394 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:41 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e869f12a-f6cf-436d-aac8-038f7211d394 Jul 06 12:07:41 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:42 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e869f12a-f6cf-436d-aac8-038f7211d394" returned: 0 in 0.912s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:07:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb5917c-8da3-437b-bc70-747207eddc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e869f12a-f6cf-436d-aac8-038f7211d394', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e9f221-fbe5-4756-90ec-51f35ef07345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:42 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Volume volume-e869f12a-f6cf-436d-aac8-038f7211d394 (e869f12a-f6cf-436d-aac8-038f7211d394): created successfully Jul 06 12:07:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e9f221-fbe5-4756-90ec-51f35ef07345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Flow 'volume_create_manager' (c4d8ff73-e26a-4f1f-85dc-d3818a7fe524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:07:42 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c7f82bf0-c3ae-4b8c-adb8-a047662d638b tempest-ServersNegativeTestJSON-211598026 None] Created volume successfully. Jul 06 12:07:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Acquiring lock "cinder-e869f12a-f6cf-436d-aac8-038f7211d394-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Lock "cinder-e869f12a-f6cf-436d-aac8-038f7211d394-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Acquiring lock "cinder-quobyte-e869f12a-f6cf-436d-aac8-038f7211d394" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Lock "cinder-quobyte-e869f12a-f6cf-436d-aac8-038f7211d394" acquired by "delete_volume" :: waited 0.040s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:45 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[61de8b2b-9bec-4a01-b296-aebc58e3596d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:07:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e869f12a-f6cf-436d-aac8-038f7211d394 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:45 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e869f12a-f6cf-436d-aac8-038f7211d394 Jul 06 12:07:45 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:46 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e869f12a-f6cf-436d-aac8-038f7211d394" returned: 0 in 1.057s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e869f12a-f6cf-436d-aac8-038f7211d394 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:46 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e869f12a-f6cf-436d-aac8-038f7211d394 Jul 06 12:07:46 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:47 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e869f12a-f6cf-436d-aac8-038f7211d394" returned: 0 in 0.862s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Lock "cinder-quobyte-e869f12a-f6cf-436d-aac8-038f7211d394" released by "delete_volume" :: held 1.970s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:47 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Created reservations ['c353f550-e68b-4f45-9197-d5494bd51262', '86d9a3fb-44d8-43a1-a673-9c2a3fd2c8c5', '7c0fcb16-aaa9-44ea-b9d6-9be9c1f9751f', '7d13158a-6757-472b-acb7-a692e5d1fa32'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:07:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:47 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:07:47 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Acquiring lock "cinder-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Lock "cinder-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Acquiring lock "cinder-quobyte-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Lock "cinder-quobyte-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd" acquired by "delete_volume" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:47 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b39bd5-3001-459a-9c09-e2b1ae53c2ba]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:07:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:47 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd Jul 06 12:07:47 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:48 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.078s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:48 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:07:48 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Deleted volume successfully. Jul 06 12:07:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e218ba7f-9aab-41ed-895d-11c02021f113 tempest-ServersNegativeTestJSON-211598026 None] Lock "cinder-e869f12a-f6cf-436d-aac8-038f7211d394-delete_volume" released by "delete_volume" :: held 3.387s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:48 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd" returned: 0 in 1.372s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:48 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd Jul 06 12:07:48 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:50 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd" returned: 0 in 1.152s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Lock "cinder-quobyte-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd" released by "delete_volume" :: held 2.585s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:50 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Created reservations ['7e0106bf-256d-4356-8820-ee10e7106c16', '0d07f14a-d9c0-4bfe-82ea-bd85aaa6e7fa', '1c7f8937-c8df-4ef9-8a8a-c89429d91017', '0818373f-a3aa-471a-ac7e-596aaa068907'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:07:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:50 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:07:50 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:51 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.077s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:51 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:07:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Deleted volume successfully. Jul 06 12:07:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d525241e-aaf5-4baf-8f29-d1307a167c78 tempest-ServersNegativeTestJSON-211598026 None] Lock "cinder-2fbe80b1-c4e3-4cb5-bb7c-dfa91fb9a8bd-delete_volume" released by "delete_volume" :: held 4.014s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:07:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:52 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:07:52 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:53 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.978s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:08:00 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=21,cinder:INSERT=5,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:08:01 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=24,cinder:UPDATE=35,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Flow 'volume_create_manager' (52d89a53-8e35-4e5f-9e21-0d25cbb1d446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b721f06-ca3e-4dc3-a0da-78f8149de897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b721f06-ca3e-4dc3-a0da-78f8149de897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1826565403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ee2819-2399-4fff-b87a-dbb730f8b8fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56d1211735a6451a82f461a45ca1ee98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:15Z,use_quota=True,user_id='f9a554cae44043289eba7a0337fca1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69df27f9-3f34-495a-b7a6-134c327a7b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69df27f9-3f34-495a-b7a6-134c327a7b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a2f15a-3148-448a-9681-e6a456de572e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a2f15a-3148-448a-9681-e6a456de572e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ee2819-2399-4fff-b87a-dbb730f8b8fb', 'volume_name': 'volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dd5fab-5a53-428f-8482-d5592ce83604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dd5fab-5a53-428f-8482-d5592ce83604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8610ed0-22f5-4f49-9d81-9978c8f89507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:15 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Volume c0ee2819-2399-4fff-b87a-dbb730f8b8fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb', 'volume_size': 1} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1826565403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ee2819-2399-4fff-b87a-dbb730f8b8fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56d1211735a6451a82f461a45ca1ee98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:15Z,use_quota=True,user_id='f9a554cae44043289eba7a0337fca1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Creating volume c0ee2819-2399-4fff-b87a-dbb730f8b8fb {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:08:15 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:08:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:15 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb 1073741824 Jul 06 12:08:15 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:17 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb 1073741824" returned: 0 in 1.693s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:17 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb Jul 06 12:08:17 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:18 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb" returned: 0 in 0.886s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] <== create_volume: return (2652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:08:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.654s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8610ed0-22f5-4f49-9d81-9978c8f89507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1094909d-a435-4af1-86e1-c58054bf0d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:18 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Volume volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb (c0ee2819-2399-4fff-b87a-dbb730f8b8fb): created successfully Jul 06 12:08:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1094909d-a435-4af1-86e1-c58054bf0d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Flow 'volume_create_manager' (52d89a53-8e35-4e5f-9e21-0d25cbb1d446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:18 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-e9333188-56c1-4633-8453-b863b445399f req-205861a7-a781-404d-b6ab-317f5cf93452 tempest-VolumesGetTestJSON-656341310 None] Created volume successfully. Jul 06 12:08:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Acquiring lock "cinder-c0ee2819-2399-4fff-b87a-dbb730f8b8fb-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:08:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Lock "cinder-c0ee2819-2399-4fff-b87a-dbb730f8b8fb-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:08:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Acquiring lock "cinder-quobyte-c0ee2819-2399-4fff-b87a-dbb730f8b8fb" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:08:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Lock "cinder-quobyte-c0ee2819-2399-4fff-b87a-dbb730f8b8fb" acquired by "delete_volume" :: waited 0.054s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:08:23 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1609cc22-8bb1-4ed8-a279-0184ee77fb9b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:08:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:23 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb Jul 06 12:08:23 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:25 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb" returned: 0 in 2.399s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:25 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb Jul 06 12:08:25 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:27 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c0ee2819-2399-4fff-b87a-dbb730f8b8fb" returned: 0 in 2.064s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Lock "cinder-quobyte-c0ee2819-2399-4fff-b87a-dbb730f8b8fb" released by "delete_volume" :: held 4.590s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:08:27 devstack cinder-volume[86761]: DEBUG cinder.quota [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Created reservations ['5f93061d-f903-41c7-a388-6f26d4ed61b2', 'f91d2968-5a14-469a-91d9-e03bc691bc7e', 'e1d5cd6f-8d1e-4ec3-b75c-029cec35e857', '98b811a2-0f88-495f-a8e1-3b9bdf21ae83'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:08:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:28 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:08:28 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:31 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 3.004s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:31 devstack cinder-volume[86761]: DEBUG cinder.manager [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:08:31 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Deleted volume successfully. Jul 06 12:08:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-72e28165-1a18-4dda-a98e-9e656d02a00b req-6c97a9c7-3a14-4d7d-ad5d-6e1e02702373 tempest-VolumesGetTestJSON-656341310 None] Lock "cinder-c0ee2819-2399-4fff-b87a-dbb730f8b8fb-delete_volume" released by "delete_volume" :: held 8.539s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:08:38 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=8,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:08:38 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7912e28e-d12b-4083-8e17-3ff608ae8830 tempest-GroupsTest-100078410 None] Group tempest-Group1-1302453852: creating Jul 06 12:08:38 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7912e28e-d12b-4083-8e17-3ff608ae8830 tempest-GroupsTest-100078410 None] Group tempest-Group1-1302453852: created successfully Jul 06 12:08:38 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7912e28e-d12b-4083-8e17-3ff608ae8830 tempest-GroupsTest-100078410 None] Create group completed successfully. Jul 06 12:08:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2f461434-761c-4d62-b64e-b72daca788d4 tempest-GroupsTest-100078410 None] Group tempest-Group2-1878994267: creating Jul 06 12:08:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2f461434-761c-4d62-b64e-b72daca788d4 tempest-GroupsTest-100078410 None] Group tempest-Group2-1878994267: created successfully Jul 06 12:08:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2f461434-761c-4d62-b64e-b72daca788d4 tempest-GroupsTest-100078410 None] Create group completed successfully. Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Flow 'volume_create_manager' (edb0e07c-2175-46b3-968f-263787967843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf55b411-969b-487e-a025-08f0024843d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf55b411-969b-487e-a025-08f0024843d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1508927311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0e9d60f-26ba-423b-94a0-9a90254dff6a,host='devstack@QuobyteHD#QuobyteHD',id=1eb79293-7717-4c13-b475-fadae1f6402a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bfbe2c5144f71bd4694f4f7397e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:42Z,use_quota=True,user_id='91c8f655344e4456999c0df23d8623be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e9266d1-e377-498b-bde2-9146e66cb3bb),volume_type_id=5e9266d1-e377-498b-bde2-9146e66cb3bb)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b931f26a-7ec9-494e-9374-6225ea499461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b931f26a-7ec9-494e-9374-6225ea499461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd4219d-8a0f-4275-904a-159b874e0edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd4219d-8a0f-4275-904a-159b874e0edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb79293-7717-4c13-b475-fadae1f6402a', 'volume_name': 'volume-1eb79293-7717-4c13-b475-fadae1f6402a', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4deb00-4e9f-44aa-94b8-eef85a5e4f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4deb00-4e9f-44aa-94b8-eef85a5e4f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55fc594-3874-49b5-bbfe-97ae58d905e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:41 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Volume 1eb79293-7717-4c13-b475-fadae1f6402a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb79293-7717-4c13-b475-fadae1f6402a', 'volume_size': 1} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d0e9d60f-26ba-423b-94a0-9a90254dff6a,created_at=2026-07-06T10:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1508927311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0e9d60f-26ba-423b-94a0-9a90254dff6a,host='devstack@QuobyteHD#QuobyteHD',id=1eb79293-7717-4c13-b475-fadae1f6402a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bfbe2c5144f71bd4694f4f7397e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:42Z,use_quota=True,user_id='91c8f655344e4456999c0df23d8623be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e9266d1-e377-498b-bde2-9146e66cb3bb),volume_type_id=5e9266d1-e377-498b-bde2-9146e66cb3bb)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Creating volume 1eb79293-7717-4c13-b475-fadae1f6402a {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:08:41 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:08:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1eb79293-7717-4c13-b475-fadae1f6402a 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:42 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1eb79293-7717-4c13-b475-fadae1f6402a 1073741824 Jul 06 12:08:42 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:43 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1eb79293-7717-4c13-b475-fadae1f6402a 1073741824" returned: 0 in 1.263s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1eb79293-7717-4c13-b475-fadae1f6402a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:43 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1eb79293-7717-4c13-b475-fadae1f6402a Jul 06 12:08:43 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:44 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1eb79293-7717-4c13-b475-fadae1f6402a" returned: 0 in 1.180s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:44 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] <== create_volume: return (2516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:08:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.524s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55fc594-3874-49b5-bbfe-97ae58d905e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb79293-7717-4c13-b475-fadae1f6402a', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b7bf1f-8fca-4f2b-8753-6d308590c7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:44 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Volume volume-1eb79293-7717-4c13-b475-fadae1f6402a (1eb79293-7717-4c13-b475-fadae1f6402a): created successfully Jul 06 12:08:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b7bf1f-8fca-4f2b-8753-6d308590c7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Flow 'volume_create_manager' (edb0e07c-2175-46b3-968f-263787967843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:44 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-3f3b95df-bd0c-434a-baba-7996276c7800 tempest-GroupsTest-100078410 None] Created volume successfully. Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Flow 'volume_create_manager' (b485ede8-c7ea-434e-8f7b-7a4b9832efb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631b083e-cfc3-44ff-8119-1cf90e2a80be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631b083e-cfc3-44ff-8119-1cf90e2a80be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1411862756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4b126f-cbd6-4595-a256-a63a7f25c8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3c361dd4dc44f2b749c6edec9a40f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:45Z,use_quota=True,user_id='f328ed660ad6428caa5cc820328aa6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be5e845-c079-4182-8da6-92904fbf9b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be5e845-c079-4182-8da6-92904fbf9b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc5414f-4827-4720-b88d-a5bf9d6f72e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc5414f-4827-4720-b88d-a5bf9d6f72e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a4b126f-cbd6-4595-a256-a63a7f25c8f0', 'volume_name': 'volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02773b09-58fa-4302-b058-e28bb8fd64e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02773b09-58fa-4302-b058-e28bb8fd64e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d11c998-4397-498b-a9e6-8d4992e768b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:45 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Volume 4a4b126f-cbd6-4595-a256-a63a7f25c8f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0', 'volume_size': 1} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1411862756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4b126f-cbd6-4595-a256-a63a7f25c8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3c361dd4dc44f2b749c6edec9a40f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:45Z,use_quota=True,user_id='f328ed660ad6428caa5cc820328aa6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Creating volume 4a4b126f-cbd6-4595-a256-a63a7f25c8f0 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:08:45 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:08:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:45 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0 1073741824 Jul 06 12:08:45 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:46 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Acquiring lock "cinder-quobyte-1eb79293-7717-4c13-b475-fadae1f6402a" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:08:46 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Lock "cinder-quobyte-1eb79293-7717-4c13-b475-fadae1f6402a" acquired by "delete_volume" :: waited 0.035s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:08:46 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[67547ed1-baa3-4295-8c61-a579be2f3f31]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:08:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1eb79293-7717-4c13-b475-fadae1f6402a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:47 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1eb79293-7717-4c13-b475-fadae1f6402a Jul 06 12:08:47 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:47 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0 1073741824" returned: 0 in 1.416s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:47 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0 Jul 06 12:08:47 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:47 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1eb79293-7717-4c13-b475-fadae1f6402a" returned: 0 in 0.908s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1eb79293-7717-4c13-b475-fadae1f6402a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:47 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1eb79293-7717-4c13-b475-fadae1f6402a Jul 06 12:08:47 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:48 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0" returned: 0 in 0.985s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] <== create_volume: return (2471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.481s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d11c998-4397-498b-a9e6-8d4992e768b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824d6fba-8fb8-45f5-8c05-6e0df220e5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:48 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Volume volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0 (4a4b126f-cbd6-4595-a256-a63a7f25c8f0): created successfully Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824d6fba-8fb8-45f5-8c05-6e0df220e5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Flow 'volume_create_manager' (b485ede8-c7ea-434e-8f7b-7a4b9832efb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:48 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0f8d9b29-c0c5-495e-92e5-ce52836a356a tempest-ServerRescueNegativeTestJSON-728905933 None] Created volume successfully. Jul 06 12:08:48 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1eb79293-7717-4c13-b475-fadae1f6402a" returned: 0 in 0.825s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Lock "cinder-quobyte-1eb79293-7717-4c13-b475-fadae1f6402a" released by "delete_volume" :: held 1.799s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Created reservations ['6f04dfc5-7cd2-4425-b137-9c2c7af054a0'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:08:48 devstack cinder-volume[86761]: WARNING cinder.quota [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2020276003 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2020276003, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:08:48 devstack cinder-volume[86761]: WARNING cinder.quota [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2020276003 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2020276003, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Created reservations ['e565584a-4be2-4360-b8c2-566cb724052c', 'be445462-c45b-49b4-ac7a-0e552e27bac9', 'c57395ff-5553-41e2-b53a-054d90197c0e', 'e0b8888f-a36e-4df6-9a71-bb36b4c84655'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:49 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:08:49 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:49 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-9adfeb2a-3864-4396-aab5-4b5d96e79ab3 tempest-GroupsTest-100078410 None] Created reservations ['37aa9c2c-c18d-4ee1-a562-01b98f09c086'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:08:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9adfeb2a-3864-4396-aab5-4b5d96e79ab3 tempest-GroupsTest-100078410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9adfeb2a-3864-4396-aab5-4b5d96e79ab3 tempest-GroupsTest-100078410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9adfeb2a-3864-4396-aab5-4b5d96e79ab3 tempest-GroupsTest-100078410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:49 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9adfeb2a-3864-4396-aab5-4b5d96e79ab3 tempest-GroupsTest-100078410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9adfeb2a-3864-4396-aab5-4b5d96e79ab3 tempest-GroupsTest-100078410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9adfeb2a-3864-4396-aab5-4b5d96e79ab3 tempest-GroupsTest-100078410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.975s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:49 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:08:49 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-76420ac8-63f5-4a6a-90fc-7215f352c0f7 tempest-GroupsTest-100078410 None] Delete group completed successfully. Jul 06 12:08:49 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:08:49 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:50 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9adfeb2a-3864-4396-aab5-4b5d96e79ab3 tempest-GroupsTest-100078410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.855s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:50 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-9adfeb2a-3864-4396-aab5-4b5d96e79ab3 tempest-GroupsTest-100078410 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:08:50 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-9adfeb2a-3864-4396-aab5-4b5d96e79ab3 tempest-GroupsTest-100078410 None] Delete group completed successfully. Jul 06 12:08:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6972779b-6317-4652-8f89-fac8cb19e987 tempest-GroupsTest-100078410 None] Group tempest-GroupsTest-Group-1546963295: creating Jul 06 12:08:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6972779b-6317-4652-8f89-fac8cb19e987 tempest-GroupsTest-100078410 None] Group tempest-GroupsTest-Group-1546963295: created successfully Jul 06 12:08:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6972779b-6317-4652-8f89-fac8cb19e987 tempest-GroupsTest-100078410 None] Create group completed successfully. Jul 06 12:08:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:08:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:52 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:08:52 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Flow 'volume_create_manager' (1621d7dc-ee1a-43cf-bb2f-8472f43cc520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f36f06-77b0-4b74-a0be-1fd46eb7940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f36f06-77b0-4b74-a0be-1fd46eb7940c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1466783995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0714959d-99bb-45c0-b175-9ae75240303a,host='devstack@QuobyteHD#QuobyteHD',id=e7f7ca6b-8da6-4dd6-acde-3e757b463303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bfbe2c5144f71bd4694f4f7397e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:53Z,use_quota=True,user_id='91c8f655344e4456999c0df23d8623be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86767720-55ca-46a9-b59e-d72d8cd91c60),volume_type_id=86767720-55ca-46a9-b59e-d72d8cd91c60)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec31041-82cf-4b9d-b46d-abad8c074939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec31041-82cf-4b9d-b46d-abad8c074939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e4b668-48f1-4db7-b0a7-96115a017078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e4b668-48f1-4db7-b0a7-96115a017078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7f7ca6b-8da6-4dd6-acde-3e757b463303', 'volume_name': 'volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf31c54-97d9-4d58-b04a-9092233bd7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf31c54-97d9-4d58-b04a-9092233bd7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59998c87-1670-4864-be7c-71ab93590995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:53 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Volume e7f7ca6b-8da6-4dd6-acde-3e757b463303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303', 'volume_size': 1} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0714959d-99bb-45c0-b175-9ae75240303a,created_at=2026-07-06T10:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1466783995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0714959d-99bb-45c0-b175-9ae75240303a,host='devstack@QuobyteHD#QuobyteHD',id=e7f7ca6b-8da6-4dd6-acde-3e757b463303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bfbe2c5144f71bd4694f4f7397e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:53Z,use_quota=True,user_id='91c8f655344e4456999c0df23d8623be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86767720-55ca-46a9-b59e-d72d8cd91c60),volume_type_id=86767720-55ca-46a9-b59e-d72d8cd91c60)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Creating volume e7f7ca6b-8da6-4dd6-acde-3e757b463303 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:08:53 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:53 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.973s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 8 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:08:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:08:53 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303 1073741824 Jul 06 12:08:53 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:54 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303 1073741824" returned: 0 in 0.941s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:54 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303 Jul 06 12:08:54 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:55 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303" returned: 0 in 0.696s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:08:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59998c87-1670-4864-be7c-71ab93590995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0088a0c8-8e18-4ebd-836b-015c3a0dc250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:55 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Volume volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303 (e7f7ca6b-8da6-4dd6-acde-3e757b463303): created successfully Jul 06 12:08:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0088a0c8-8e18-4ebd-836b-015c3a0dc250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Flow 'volume_create_manager' (1621d7dc-ee1a-43cf-bb2f-8472f43cc520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:55 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-73d88466-7c7a-4ec8-90f1-d3e720a55679 tempest-GroupsTest-100078410 None] Created volume successfully. Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Flow 'volume_create_manager' (5fa81128-3d47-4d4c-8682-38b67487e891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcafd499-714f-4014-96e2-0615d247aa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcafd499-714f-4014-96e2-0615d247aa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1606113436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0714959d-99bb-45c0-b175-9ae75240303a,host='devstack@QuobyteHD#QuobyteHD',id=af0c7965-136f-408a-8c5d-1b3bc838c50a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bfbe2c5144f71bd4694f4f7397e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:57Z,use_quota=True,user_id='91c8f655344e4456999c0df23d8623be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86767720-55ca-46a9-b59e-d72d8cd91c60),volume_type_id=86767720-55ca-46a9-b59e-d72d8cd91c60)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a46dfb-5511-4bda-ae0b-40f5eec88786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a46dfb-5511-4bda-ae0b-40f5eec88786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8fc709-dc20-4a60-8c75-9a0490013e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8fc709-dc20-4a60-8c75-9a0490013e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0c7965-136f-408a-8c5d-1b3bc838c50a', 'volume_name': 'volume-af0c7965-136f-408a-8c5d-1b3bc838c50a', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bba0b3-de44-4940-bbce-6a0f4cf86077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bba0b3-de44-4940-bbce-6a0f4cf86077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb70921-586b-415e-a899-ef7805114a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:56 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Volume af0c7965-136f-408a-8c5d-1b3bc838c50a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0c7965-136f-408a-8c5d-1b3bc838c50a', 'volume_size': 1} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0714959d-99bb-45c0-b175-9ae75240303a,created_at=2026-07-06T10:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1606113436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0714959d-99bb-45c0-b175-9ae75240303a,host='devstack@QuobyteHD#QuobyteHD',id=af0c7965-136f-408a-8c5d-1b3bc838c50a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bfbe2c5144f71bd4694f4f7397e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:57Z,use_quota=True,user_id='91c8f655344e4456999c0df23d8623be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86767720-55ca-46a9-b59e-d72d8cd91c60),volume_type_id=86767720-55ca-46a9-b59e-d72d8cd91c60)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Creating volume af0c7965-136f-408a-8c5d-1b3bc838c50a {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:08:56 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:08:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af0c7965-136f-408a-8c5d-1b3bc838c50a 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:56 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af0c7965-136f-408a-8c5d-1b3bc838c50a 1073741824 Jul 06 12:08:56 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:57 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af0c7965-136f-408a-8c5d-1b3bc838c50a 1073741824" returned: 0 in 0.973s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af0c7965-136f-408a-8c5d-1b3bc838c50a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:58 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af0c7965-136f-408a-8c5d-1b3bc838c50a Jul 06 12:08:58 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:58 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af0c7965-136f-408a-8c5d-1b3bc838c50a" returned: 0 in 0.984s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:08:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb70921-586b-415e-a899-ef7805114a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0c7965-136f-408a-8c5d-1b3bc838c50a', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (635540f8-5b1c-4b07-b16b-da3210d78706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:59 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Volume volume-af0c7965-136f-408a-8c5d-1b3bc838c50a (af0c7965-136f-408a-8c5d-1b3bc838c50a): created successfully Jul 06 12:08:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (635540f8-5b1c-4b07-b16b-da3210d78706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Flow 'volume_create_manager' (5fa81128-3d47-4d4c-8682-38b67487e891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:59 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4ed3eba9-020a-4e27-a722-727c574fc7d9 tempest-GroupsTest-100078410 None] Created volume successfully. Jul 06 12:08:59 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ca49b706-8637-4af1-9e7b-9e52337da5d1 tempest-GroupsTest-100078410 None] Update group completed successfully. Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Flow 'volume_create_manager' (aa9c8d78-aabe-44bd-82b7-f2938fc51a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5bd67d-1942-4324-9c78-df88992c8816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5bd67d-1942-4324-9c78-df88992c8816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1911260272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5325f77b-54a7-4396-aa1a-8409859ca732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab252f12ace547a69663b49c1d7a0d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:00Z,use_quota=True,user_id='57a047a1b83c42fcbba90227d1bfc65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262ae555-67e2-4ac1-90f6-7cb12d9a02a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262ae555-67e2-4ac1-90f6-7cb12d9a02a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b6fa07-12de-49cc-ad6c-64b2c9a368c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b6fa07-12de-49cc-ad6c-64b2c9a368c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5325f77b-54a7-4396-aa1a-8409859ca732', 'volume_name': 'volume-5325f77b-54a7-4396-aa1a-8409859ca732', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f37bd1c-2ea7-4f9a-8f73-5919b2fb6eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f37bd1c-2ea7-4f9a-8f73-5919b2fb6eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97bb31e-2e33-486f-b146-857b7b7a9edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:00 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Volume 5325f77b-54a7-4396-aa1a-8409859ca732: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5325f77b-54a7-4396-aa1a-8409859ca732', 'volume_size': 1} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1911260272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5325f77b-54a7-4396-aa1a-8409859ca732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab252f12ace547a69663b49c1d7a0d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:00Z,use_quota=True,user_id='57a047a1b83c42fcbba90227d1bfc65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Creating volume 5325f77b-54a7-4396-aa1a-8409859ca732 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:09:00 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:09:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:00 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732 1073741824 Jul 06 12:09:00 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:01 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-5596133f-0419-4ab0-8a39-6161189431cb tempest-GroupsTest-100078410 None] Update group completed successfully. Jul 06 12:09:02 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732 1073741824" returned: 0 in 1.683s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:02 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732 Jul 06 12:09:02 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:03 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732" returned: 0 in 0.885s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] <== create_volume: return (2644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:09:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.654s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97bb31e-2e33-486f-b146-857b7b7a9edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5325f77b-54a7-4396-aa1a-8409859ca732', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ca983a-92ac-4aba-bd25-7f789c8d287a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:03 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Volume volume-5325f77b-54a7-4396-aa1a-8409859ca732 (5325f77b-54a7-4396-aa1a-8409859ca732): created successfully Jul 06 12:09:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ca983a-92ac-4aba-bd25-7f789c8d287a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Flow 'volume_create_manager' (aa9c8d78-aabe-44bd-82b7-f2938fc51a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:03 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d2adec2b-34d4-4435-a560-72f8d6ab6814 tempest-ServerActionsTestOtherA-822197278 None] Created volume successfully. Jul 06 12:09:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Acquiring lock "cinder-quobyte-af0c7965-136f-408a-8c5d-1b3bc838c50a" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Lock "cinder-quobyte-af0c7965-136f-408a-8c5d-1b3bc838c50a" acquired by "delete_volume" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:03 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db695c3-8292-419f-ab71-727a9efbf81e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af0c7965-136f-408a-8c5d-1b3bc838c50a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:03 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af0c7965-136f-408a-8c5d-1b3bc838c50a Jul 06 12:09:03 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:04 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af0c7965-136f-408a-8c5d-1b3bc838c50a" returned: 0 in 1.094s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af0c7965-136f-408a-8c5d-1b3bc838c50a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:04 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af0c7965-136f-408a-8c5d-1b3bc838c50a Jul 06 12:09:04 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:06 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af0c7965-136f-408a-8c5d-1b3bc838c50a" returned: 0 in 1.434s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Lock "cinder-quobyte-af0c7965-136f-408a-8c5d-1b3bc838c50a" released by "delete_volume" :: held 2.583s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Acquiring lock "cinder-quobyte-e7f7ca6b-8da6-4dd6-acde-3e757b463303" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Lock "cinder-quobyte-e7f7ca6b-8da6-4dd6-acde-3e757b463303" acquired by "delete_volume" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:06 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f227fba-b6e8-4d02-9a39-0440be01374c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:06 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303 Jul 06 12:09:06 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:07 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303" returned: 0 in 1.514s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:07 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303 Jul 06 12:09:07 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:09 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e7f7ca6b-8da6-4dd6-acde-3e757b463303" returned: 0 in 1.115s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Lock "cinder-quobyte-e7f7ca6b-8da6-4dd6-acde-3e757b463303" released by "delete_volume" :: held 2.704s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:09 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Created reservations ['1dbcb863-7fa4-4469-8ccc-39adcb0f24ab'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:09:09 devstack cinder-volume[86761]: WARNING cinder.quota [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-19528232 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-19528232, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:09:09 devstack cinder-volume[86761]: WARNING cinder.quota [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-19528232 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-19528232, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:09:09 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Created reservations ['44e50b68-11e8-4de3-b816-4c8becd07109', 'd2cc4f78-0bb2-4c17-b757-d3f0a5946183', '585ebe7e-1ee6-475e-ad36-f79b197acb76', '10f75d6e-5e00-4c0f-8cd4-f693797068ef'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:09:09 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Created reservations ['8383a65a-a36b-41ae-ae6b-be023a4ebaca', 'fb8807c6-6d00-4eab-938a-3610f792d4ce', '38f55d24-9b72-4d8d-9b76-484c583a31cc', '1d6d9649-bf46-48d1-889f-ce4da40fda7a'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:09:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:09 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:09:09 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Acquiring lock "cinder-4a4b126f-cbd6-4595-a256-a63a7f25c8f0-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Lock "cinder-4a4b126f-cbd6-4595-a256-a63a7f25c8f0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Acquiring lock "cinder-quobyte-4a4b126f-cbd6-4595-a256-a63a7f25c8f0" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Lock "cinder-quobyte-4a4b126f-cbd6-4595-a256-a63a7f25c8f0" acquired by "delete_volume" :: waited 0.033s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:10 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7548aed1-841b-4400-acaa-caa97a156682]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:10 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0 Jul 06 12:09:10 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:10 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.117s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:10 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:09:10 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-86dfe0bd-a9fe-4535-bff8-321124efe597 tempest-GroupsTest-100078410 None] Delete group completed successfully. Jul 06 12:09:11 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0" returned: 0 in 1.463s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:11 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0 Jul 06 12:09:11 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:12 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4a4b126f-cbd6-4595-a256-a63a7f25c8f0" returned: 0 in 0.962s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Lock "cinder-quobyte-4a4b126f-cbd6-4595-a256-a63a7f25c8f0" released by "delete_volume" :: held 2.508s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:12 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=52,cinder:UPDATE=61,cinder:DELETE=3,cinder:INSERT=16 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:09:12 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Created reservations ['cdd3bfa3-fd08-411e-ae3e-ca0eabb7b6cf', '226e459d-f332-4455-a0d1-b471cb901c47', 'd703c387-7995-4ce4-a264-406fd8493458', 'a8606d26-0dd9-4b58-b19b-a2f27ccc12d5'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:09:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:13 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:09:13 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:14 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.260s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:14 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:09:14 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Deleted volume successfully. Jul 06 12:09:14 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e84543b7-3e94-434c-ae1f-7cbb06d136bb tempest-ServerRescueNegativeTestJSON-728905933 None] Lock "cinder-4a4b126f-cbd6-4595-a256-a63a7f25c8f0-delete_volume" released by "delete_volume" :: held 4.270s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-d23247c4-695c-4026-96dd-0bda08fdeb28 req-7bf83e97-29ba-4b22-9177-7799e92a8713 tempest-TaggedAttachmentsTest-1982372257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-d23247c4-695c-4026-96dd-0bda08fdeb28 req-7bf83e97-29ba-4b22-9177-7799e92a8713 tempest-TaggedAttachmentsTest-1982372257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:15 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71779b4-f3a0-48be-9f6e-3914587029f3]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-d23247c4-695c-4026-96dd-0bda08fdeb28 req-7bf83e97-29ba-4b22-9177-7799e92a8713 tempest-TaggedAttachmentsTest-1982372257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:15 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39 Jul 06 12:09:15 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:16 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-d23247c4-695c-4026-96dd-0bda08fdeb28 req-7bf83e97-29ba-4b22-9177-7799e92a8713 tempest-TaggedAttachmentsTest-1982372257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39" returned: 0 in 1.552s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-d23247c4-695c-4026-96dd-0bda08fdeb28 req-7bf83e97-29ba-4b22-9177-7799e92a8713 tempest-TaggedAttachmentsTest-1982372257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.570s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-d23247c4-695c-4026-96dd-0bda08fdeb28 req-7bf83e97-29ba-4b22-9177-7799e92a8713 tempest-TaggedAttachmentsTest-1982372257 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1dc485b-3b03-4760-a0e2-fa7506d2270e', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:09:16 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-d23247c4-695c-4026-96dd-0bda08fdeb28 req-7bf83e97-29ba-4b22-9177-7799e92a8713 tempest-TaggedAttachmentsTest-1982372257 None] attachment_update completed successfully. Jul 06 12:09:26 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-284953dd-7c94-4748-9551-bb3ab5f1266a req-02c707d9-076c-4909-a521-bdb10e285160 tempest-TaggedAttachmentsTest-1982372257 None] Terminate volume connection completed successfully. Jul 06 12:09:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-284953dd-7c94-4748-9551-bb3ab5f1266a req-02c707d9-076c-4909-a521-bdb10e285160 tempest-TaggedAttachmentsTest-1982372257 None] Deleting attachment a1dc485b-3b03-4760-a0e2-fa7506d2270e. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Flow 'volume_create_manager' (c8cfce37-caeb-4818-8117-163674cf7b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346bdbf3-ba58-4756-b4b9-a37ca0493360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346bdbf3-ba58-4756-b4b9-a37ca0493360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1655701092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3a62c4-6c6a-477e-a190-3ed757cd2a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f73b3a910341f19a53d26fc5754bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:30Z,use_quota=True,user_id='59a3cf7b1f0842ada91c6c04e5db4c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21f247c-64d7-4740-9cc7-d1c64824beeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21f247c-64d7-4740-9cc7-d1c64824beeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f86954a-e082-47e5-a00c-12e4febfbcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f86954a-e082-47e5-a00c-12e4febfbcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f3a62c4-6c6a-477e-a190-3ed757cd2a9d', 'volume_name': 'volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb29bcf3-586b-459f-b6f9-1ddead06ab29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb29bcf3-586b-459f-b6f9-1ddead06ab29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da43c867-3d32-4017-9e51-7a38291cfe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:29 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Volume 0f3a62c4-6c6a-477e-a190-3ed757cd2a9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d', 'volume_size': 1} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1655701092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3a62c4-6c6a-477e-a190-3ed757cd2a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f73b3a910341f19a53d26fc5754bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:30Z,use_quota=True,user_id='59a3cf7b1f0842ada91c6c04e5db4c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Creating volume 0f3a62c4-6c6a-477e-a190-3ed757cd2a9d {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:09:29 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:09:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:29 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d 1073741824 Jul 06 12:09:29 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:31 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d 1073741824" returned: 0 in 1.741s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:31 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d Jul 06 12:09:31 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:32 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d" returned: 0 in 1.143s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] <== create_volume: return (3024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:09:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.028s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da43c867-3d32-4017-9e51-7a38291cfe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a458e1a7-9cc8-465c-872f-e85525ad322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:32 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Volume volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d (0f3a62c4-6c6a-477e-a190-3ed757cd2a9d): created successfully Jul 06 12:09:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a458e1a7-9cc8-465c-872f-e85525ad322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Flow 'volume_create_manager' (c8cfce37-caeb-4818-8117-163674cf7b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:32 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0734ccbb-c480-43fe-b538-7823350ad231 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Created volume successfully. Jul 06 12:09:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Creating offline snapshot 8f57fb7d-a125-44c5-a934-eb949f8af95c of volume 0f3a62c4-6c6a-477e-a190-3ed757cd2a9d {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:09:33 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf0bef1-1492-4425-a09d-810cac6cd4cb]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:33 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d Jul 06 12:09:33 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:34 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d" returned: 0 in 1.036s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:34 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c 1G Jul 06 12:09:34 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:35 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c 1G" returned: 0 in 1.179s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:35 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c Jul 06 12:09:35 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:36 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c" returned: 0 in 1.152s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:36 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c is being set with open permissions: ugo+rw Jul 06 12:09:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:37 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c Jul 06 12:09:37 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:37 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c" returned: 0 in 0.839s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:37 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.info Jul 06 12:09:37 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:38 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.info" returned: 0 in 0.729s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:38 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.info is being set with open permissions: ugo+rw Jul 06 12:09:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:38 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.info Jul 06 12:09:38 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:39 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.info" returned: 0 in 1.087s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.146s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:39 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=65,cinder:UPDATE=67,cinder:DELETE=5,cinder:INSERT=11 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:09:39 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-fd3d7eb3-95bc-489a-9ba6-224515338783 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Create snapshot completed successfully Jul 06 12:09:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Acquiring lock "cinder-8f57fb7d-a125-44c5-a934-eb949f8af95c-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "cinder-8f57fb7d-a125-44c5-a934-eb949f8af95c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Acquiring lock "cinder-quobyte-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "cinder-quobyte-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Acquiring lock "cinder-quobyte-8f57fb7d-a125-44c5-a934-eb949f8af95c" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "cinder-quobyte-8f57fb7d-a125-44c5-a934-eb949f8af95c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Deleting offline snapshot 8f57fb7d-a125-44c5-a934-eb949f8af95c of volume 0f3a62c4-6c6a-477e-a190-3ed757cd2a9d {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:09:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] snapshot_file for this snap is: volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:09:40 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0187bbf8-f8ef-4032-bb42-1a60cf076f24]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:40 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c Jul 06 12:09:40 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:41 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c" returned: 0 in 0.981s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:09:41 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[47343428-9402-492d-a307-62ecbddc220f]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:41 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d Jul 06 12:09:41 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Flow 'volume_create_manager' (4df25a68-150c-421e-908f-b52bc668fc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baba8343-9361-4a5b-904d-0d861d2ef001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baba8343-9361-4a5b-904d-0d861d2ef001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-849341704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2f039f-8fcd-47c2-be21-87459f10d246,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2059b390d6d34a72b8210ae4d07d0af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:42Z,use_quota=True,user_id='b9ce329e89884751aa2e786db16a8c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afda4d32-31c5-44f6-bd64-ed402ab4c779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afda4d32-31c5-44f6-bd64-ed402ab4c779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5df8cf-86c5-414a-a8f0-3bb17738c4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5df8cf-86c5-414a-a8f0-3bb17738c4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae2f039f-8fcd-47c2-be21-87459f10d246', 'volume_name': 'volume-ae2f039f-8fcd-47c2-be21-87459f10d246', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5812c247-d6c0-4a07-a5f4-1ce0495a60a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5812c247-d6c0-4a07-a5f4-1ce0495a60a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4e6b2b-7b86-44ed-beb1-7ea159d5d029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:42 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Volume ae2f039f-8fcd-47c2-be21-87459f10d246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae2f039f-8fcd-47c2-be21-87459f10d246', 'volume_size': 1} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-849341704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2f039f-8fcd-47c2-be21-87459f10d246,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2059b390d6d34a72b8210ae4d07d0af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:42Z,use_quota=True,user_id='b9ce329e89884751aa2e786db16a8c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Creating volume ae2f039f-8fcd-47c2-be21-87459f10d246 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:09:42 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ae2f039f-8fcd-47c2-be21-87459f10d246 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:42 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ae2f039f-8fcd-47c2-be21-87459f10d246 1073741824 Jul 06 12:09:42 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:42 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d" returned: 0 in 0.851s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:42 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c Jul 06 12:09:42 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:43 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ae2f039f-8fcd-47c2-be21-87459f10d246 1073741824" returned: 0 in 1.001s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ae2f039f-8fcd-47c2-be21-87459f10d246 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:43 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:43 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ae2f039f-8fcd-47c2-be21-87459f10d246 Jul 06 12:09:43 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c" returned: 0 in 0.939s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:43 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c Jul 06 12:09:43 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:44 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d.8f57fb7d-a125-44c5-a934-eb949f8af95c" returned: 0 in 0.845s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:44 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ae2f039f-8fcd-47c2-be21-87459f10d246" returned: 0 in 0.912s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:44 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:09:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "cinder-quobyte-8f57fb7d-a125-44c5-a934-eb949f8af95c" released by "_delete_snapshot" :: held 3.758s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4e6b2b-7b86-44ed-beb1-7ea159d5d029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae2f039f-8fcd-47c2-be21-87459f10d246', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44fadd6-5103-4941-b1f7-3e9847b74d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "cinder-quobyte-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d" released by "delete_snapshot" :: held 3.805s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:44 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Volume volume-ae2f039f-8fcd-47c2-be21-87459f10d246 (ae2f039f-8fcd-47c2-be21-87459f10d246): created successfully Jul 06 12:09:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44fadd6-5103-4941-b1f7-3e9847b74d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Flow 'volume_create_manager' (4df25a68-150c-421e-908f-b52bc668fc12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:44 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7aae3588-49f0-4e7e-99c9-d0272226376c tempest-VolumesTestJSON-2084595785 None] Created volume successfully. Jul 06 12:09:44 devstack cinder-volume[86761]: WARNING cinder.quota [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:09:44 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Created reservations ['2a2f9cdd-4b05-4590-9131-480d17b947a8', '1834152e-4b15-4b00-84de-84597616c18e', 'd802bd6c-3b3d-4bd0-9241-ec1e8feeeeaa', 'a6abba20-3945-4af4-859f-74ccc75495ce'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:09:44 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Delete snapshot completed successfully. Jul 06 12:09:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-51ede72f-5bef-4dfb-8211-ea5446765053 tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "cinder-8f57fb7d-a125-44c5-a934-eb949f8af95c-delete_snapshot" released by "delete_snapshot" :: held 4.114s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Acquiring lock "cinder-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "cinder-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Acquiring lock "cinder-quobyte-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "cinder-quobyte-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:45 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[e127f41c-cb8b-4632-bcc3-89c1691e72aa]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:45 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d Jul 06 12:09:45 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Flow 'volume_create_manager' (f1ef2c6c-eec8-4972-89c3-3e0355bf9d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2ccd97-5120-46dd-968d-ae1deddd92ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2ccd97-5120-46dd-968d-ae1deddd92ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-344634749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58888230-42ee-4043-8e73-2437ed7928fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2059b390d6d34a72b8210ae4d07d0af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:46Z,use_quota=True,user_id='b9ce329e89884751aa2e786db16a8c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542e0460-0216-4a89-bb6b-361da2c2e203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542e0460-0216-4a89-bb6b-361da2c2e203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd18633-602d-4611-bc93-308d30e152a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:46 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd18633-602d-4611-bc93-308d30e152a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58888230-42ee-4043-8e73-2437ed7928fb', 'volume_name': 'volume-58888230-42ee-4043-8e73-2437ed7928fb', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c790619f-75e9-41c1-8cc8-f33c710725cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c790619f-75e9-41c1-8cc8-f33c710725cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e202966-d878-41b7-afeb-776e54a006f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:46 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Volume 58888230-42ee-4043-8e73-2437ed7928fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58888230-42ee-4043-8e73-2437ed7928fb', 'volume_size': 1} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-344634749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58888230-42ee-4043-8e73-2437ed7928fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2059b390d6d34a72b8210ae4d07d0af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:46Z,use_quota=True,user_id='b9ce329e89884751aa2e786db16a8c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Creating volume 58888230-42ee-4043-8e73-2437ed7928fb {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:09:46 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58888230-42ee-4043-8e73-2437ed7928fb 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d" returned: 0 in 1.131s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:46 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58888230-42ee-4043-8e73-2437ed7928fb 1073741824 Jul 06 12:09:46 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:46 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d Jul 06 12:09:46 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:47 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d" returned: 0 in 0.776s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "cinder-quobyte-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d" released by "delete_volume" :: held 2.034s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Acquiring lock "cinder-33c78a10-f946-4f13-b6cd-bd68c8bd1b39-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Created reservations ['8e38dbe8-6d52-4975-9c6f-e1113a177b2f', '3e304ccc-dcff-493f-b682-62682addcecf', '14b3203a-b788-471e-92b8-aa79658d1d09', '59608605-34bc-4e45-8a2d-b23e0a419a16'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Lock "cinder-33c78a10-f946-4f13-b6cd-bd68c8bd1b39-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Acquiring lock "cinder-quobyte-33c78a10-f946-4f13-b6cd-bd68c8bd1b39" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Lock "cinder-quobyte-33c78a10-f946-4f13-b6cd-bd68c8bd1b39" acquired by "delete_volume" :: waited 0.039s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:47 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:47 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:09:47 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58888230-42ee-4043-8e73-2437ed7928fb 1073741824" returned: 0 in 1.095s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dd2fd1-7b12-42d2-b10c-57ba271273a1]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58888230-42ee-4043-8e73-2437ed7928fb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:47 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58888230-42ee-4043-8e73-2437ed7928fb Jul 06 12:09:47 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:47 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39 Jul 06 12:09:47 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:48 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.848s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:48 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:09:48 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Deleted volume successfully. Jul 06 12:09:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9e904466-da71-44e9-8efe-406d0399646f tempest-VolumeSnapshotQuotasNegativeTestJSON-733273612 None] Lock "cinder-0f3a62c4-6c6a-477e-a190-3ed757cd2a9d-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:48 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58888230-42ee-4043-8e73-2437ed7928fb" returned: 0 in 0.925s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:09:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e202966-d878-41b7-afeb-776e54a006f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58888230-42ee-4043-8e73-2437ed7928fb', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749c1d9e-ef9e-4320-abb4-60188fa15830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:48 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Volume volume-58888230-42ee-4043-8e73-2437ed7928fb (58888230-42ee-4043-8e73-2437ed7928fb): created successfully Jul 06 12:09:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749c1d9e-ef9e-4320-abb4-60188fa15830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Flow 'volume_create_manager' (f1ef2c6c-eec8-4972-89c3-3e0355bf9d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:48 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b0b49323-530c-4ef7-b293-f3bd4a9db46c tempest-VolumesTestJSON-2084595785 None] Created volume successfully. Jul 06 12:09:48 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39" returned: 0 in 1.083s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:48 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39 Jul 06 12:09:48 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:49 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-33c78a10-f946-4f13-b6cd-bd68c8bd1b39" returned: 0 in 0.797s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Lock "cinder-quobyte-33c78a10-f946-4f13-b6cd-bd68c8bd1b39" released by "delete_volume" :: held 1.947s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:49 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Created reservations ['72ce02d0-b813-4b0c-b220-bf5b8ca5b9b1', '4287c24e-2349-4a28-b7e8-59f5cc0ff26f', 'fe612f00-9f5a-4330-a31f-004aa377439c', '1316a8a3-ecfb-49ca-a875-40bb319888fc'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:09:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:49 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:09:49 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Flow 'volume_create_manager' (9c3fd311-c233-43c7-914a-ff18961844e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc11bfe5-baeb-4693-a848-867812af8861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc11bfe5-baeb-4693-a848-867812af8861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1564432274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e2370a8-ef2b-40f8-927e-f2cf77d5703a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2059b390d6d34a72b8210ae4d07d0af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:50Z,use_quota=True,user_id='b9ce329e89884751aa2e786db16a8c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16548a32-7fee-4630-bc41-e80d0f1401cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16548a32-7fee-4630-bc41-e80d0f1401cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec190fa-d0f0-4402-b894-809a9a360e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec190fa-d0f0-4402-b894-809a9a360e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e2370a8-ef2b-40f8-927e-f2cf77d5703a', 'volume_name': 'volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7690c1-b43c-4136-9924-66925edc4266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7690c1-b43c-4136-9924-66925edc4266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c3db15-b39f-4e52-a184-12c11b837023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:50 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Volume 4e2370a8-ef2b-40f8-927e-f2cf77d5703a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a', 'volume_size': 1} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1564432274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e2370a8-ef2b-40f8-927e-f2cf77d5703a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2059b390d6d34a72b8210ae4d07d0af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:50Z,use_quota=True,user_id='b9ce329e89884751aa2e786db16a8c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Creating volume 4e2370a8-ef2b-40f8-927e-f2cf77d5703a {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:09:50 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:50 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a 1073741824 Jul 06 12:09:50 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:50 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.938s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:09:50 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Deleted volume successfully. Jul 06 12:09:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f3c81944-63d3-49df-a77e-30ca24b81ff7 tempest-TaggedAttachmentsTest-1982372257 None] Lock "cinder-33c78a10-f946-4f13-b6cd-bd68c8bd1b39-delete_volume" released by "delete_volume" :: held 3.245s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:51 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a 1073741824" returned: 0 in 1.297s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:51 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a Jul 06 12:09:51 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-8ac77798-2d02-487e-9c5a-ea8dcec3cc5b req-b528a744-e386-4778-9942-f9fbfc2d50ec tempest-ServerActionsTestOtherA-822197278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:52 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:09:52 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:52 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a" returned: 0 in 0.931s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] <== create_volume: return (2314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.317s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-8ac77798-2d02-487e-9c5a-ea8dcec3cc5b req-b528a744-e386-4778-9942-f9fbfc2d50ec tempest-ServerActionsTestOtherA-822197278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.423s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cab441-d4e0-4df8-8920-37e7d312f85f]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-8ac77798-2d02-487e-9c5a-ea8dcec3cc5b req-b528a744-e386-4778-9942-f9fbfc2d50ec tempest-ServerActionsTestOtherA-822197278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c3db15-b39f-4e52-a184-12c11b837023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fed528-f753-4499-a91b-28fcc01e12cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:52 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Volume volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a (4e2370a8-ef2b-40f8-927e-f2cf77d5703a): created successfully Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fed528-f753-4499-a91b-28fcc01e12cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Flow 'volume_create_manager' (9c3fd311-c233-43c7-914a-ff18961844e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:52 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-07ae949a-8fdd-46b3-bd2a-55f3febd6d00 tempest-VolumesTestJSON-2084595785 None] Created volume successfully. Jul 06 12:09:52 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732 Jul 06 12:09:52 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:53 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.992s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:09:54 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-8ac77798-2d02-487e-9c5a-ea8dcec3cc5b req-b528a744-e386-4778-9942-f9fbfc2d50ec tempest-ServerActionsTestOtherA-822197278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732" returned: 0 in 1.330s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-8ac77798-2d02-487e-9c5a-ea8dcec3cc5b req-b528a744-e386-4778-9942-f9fbfc2d50ec tempest-ServerActionsTestOtherA-822197278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.373s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-8ac77798-2d02-487e-9c5a-ea8dcec3cc5b req-b528a744-e386-4778-9942-f9fbfc2d50ec tempest-ServerActionsTestOtherA-822197278 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-5325f77b-54a7-4396-aa1a-8409859ca732', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0d8d3ec-6114-4275-96fa-607bb5f48747', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:09:54 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-8ac77798-2d02-487e-9c5a-ea8dcec3cc5b req-b528a744-e386-4778-9942-f9fbfc2d50ec tempest-ServerActionsTestOtherA-822197278 None] attachment_update completed successfully. Jul 06 12:09:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Acquiring lock "cinder-4e2370a8-ef2b-40f8-927e-f2cf77d5703a-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Lock "cinder-4e2370a8-ef2b-40f8-927e-f2cf77d5703a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Acquiring lock "cinder-quobyte-4e2370a8-ef2b-40f8-927e-f2cf77d5703a" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Lock "cinder-quobyte-4e2370a8-ef2b-40f8-927e-f2cf77d5703a" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:55 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f1092d-945b-4478-9e0a-348df9f98ee2]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:55 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a Jul 06 12:09:55 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:56 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a" returned: 0 in 1.018s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:56 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a Jul 06 12:09:56 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:57 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e2370a8-ef2b-40f8-927e-f2cf77d5703a" returned: 0 in 0.900s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Lock "cinder-quobyte-4e2370a8-ef2b-40f8-927e-f2cf77d5703a" released by "delete_volume" :: held 1.995s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:57 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Created reservations ['8740d910-90c5-45fa-9762-e31870b45bf6', '6dc56173-ec09-4619-b947-db3e38ec3cd4', '13c70b0b-1e72-4d11-ba99-9dde9152981c', 'da4b4ffb-394a-43b0-bdd5-ab7183973deb'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:09:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:57 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:09:57 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:58 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.085s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:58 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:09:58 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Deleted volume successfully. Jul 06 12:09:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dcc8afa4-343d-4579-a6e5-16bebe35840d tempest-VolumesTestJSON-2084595785 None] Lock "cinder-4e2370a8-ef2b-40f8-927e-f2cf77d5703a-delete_volume" released by "delete_volume" :: held 3.406s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Acquiring lock "cinder-58888230-42ee-4043-8e73-2437ed7928fb-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Lock "cinder-58888230-42ee-4043-8e73-2437ed7928fb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Acquiring lock "cinder-quobyte-58888230-42ee-4043-8e73-2437ed7928fb" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Lock "cinder-quobyte-58888230-42ee-4043-8e73-2437ed7928fb" acquired by "delete_volume" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1785ddc1-3d5e-40ed-9916-a6e21cce4d57]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58888230-42ee-4043-8e73-2437ed7928fb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:58 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58888230-42ee-4043-8e73-2437ed7928fb Jul 06 12:09:58 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:59 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58888230-42ee-4043-8e73-2437ed7928fb" returned: 0 in 1.221s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58888230-42ee-4043-8e73-2437ed7928fb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:59 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58888230-42ee-4043-8e73-2437ed7928fb Jul 06 12:09:59 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:00 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58888230-42ee-4043-8e73-2437ed7928fb" returned: 0 in 0.914s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Lock "cinder-quobyte-58888230-42ee-4043-8e73-2437ed7928fb" released by "delete_volume" :: held 2.222s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:01 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Created reservations ['08b39dcd-dc29-4424-8269-66199f0ea53a', '002cb7dc-b6cb-4a5c-845d-c7e7f3c04b81', '0fea6511-04ed-44ad-9b82-492ea1465e9c', '3af051c1-aae3-43ab-b4f2-26ba335aca85'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:10:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:01 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:10:01 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Acquiring lock "cinder-ae2f039f-8fcd-47c2-be21-87459f10d246-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Lock "cinder-ae2f039f-8fcd-47c2-be21-87459f10d246-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Acquiring lock "cinder-quobyte-ae2f039f-8fcd-47c2-be21-87459f10d246" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:02 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Lock "cinder-quobyte-ae2f039f-8fcd-47c2-be21-87459f10d246" acquired by "delete_volume" :: waited 0.035s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.215s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:02 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:10:02 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Deleted volume successfully. Jul 06 12:10:02 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d6c7b3-a68d-459b-b528-2b2e49802cdd]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ae2f039f-8fcd-47c2-be21-87459f10d246 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b4528d8e-14e2-404b-bbf0-df8460a0bd4b tempest-VolumesTestJSON-2084595785 None] Lock "cinder-58888230-42ee-4043-8e73-2437ed7928fb-delete_volume" released by "delete_volume" :: held 3.838s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:02 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ae2f039f-8fcd-47c2-be21-87459f10d246 Jul 06 12:10:02 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:03 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ae2f039f-8fcd-47c2-be21-87459f10d246" returned: 0 in 1.144s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ae2f039f-8fcd-47c2-be21-87459f10d246 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:03 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ae2f039f-8fcd-47c2-be21-87459f10d246 Jul 06 12:10:03 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:04 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-e3398a6b-42d8-4454-b986-c579c360c694 req-0e883f3e-d713-44d3-9e92-659c6a42d4c9 tempest-ServerActionsTestOtherA-822197278 None] Terminate volume connection completed successfully. Jul 06 12:10:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e3398a6b-42d8-4454-b986-c579c360c694 req-0e883f3e-d713-44d3-9e92-659c6a42d4c9 tempest-ServerActionsTestOtherA-822197278 None] Deleting attachment f0d8d3ec-6114-4275-96fa-607bb5f48747. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:10:04 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ae2f039f-8fcd-47c2-be21-87459f10d246" returned: 0 in 1.030s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Lock "cinder-quobyte-ae2f039f-8fcd-47c2-be21-87459f10d246" released by "delete_volume" :: held 2.255s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:04 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Created reservations ['46003974-9477-4e8c-aa55-bee46e1ad12b', '7d4f3330-93af-4681-a96b-20c3ebfc1cab', '7b2edbcb-32f6-4d1c-9f9d-2250b77b0042', '85ab4716-52fb-41db-8800-73310544dc52'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:10:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:04 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:10:04 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:05 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:10:05 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Flow 'volume_create_manager' (b23867a7-7279-4822-b89e-6ed05dea3a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:05 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d98d8a-761c-4630-8b43-c861076307de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:05 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:05 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d98d8a-761c-4630-8b43-c861076307de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1096985311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b458b85-0646-4ebf-82be-6b976f7df4b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ebc8076a11454095f396f26dbcf41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:06Z,use_quota=True,user_id='2d65afc8daac4b9098d540c25d8820c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:05 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60194d98-03d5-4388-a318-77a6387149ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:05 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60194d98-03d5-4388-a318-77a6387149ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:05 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661a824d-3644-4770-b9ff-78fced11a762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:05 devstack cinder-volume[86761]: DEBUG cinder.image.glance [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Creating Keystone auth plugin from conf {{(pid=86761) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:10:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.116s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:05 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:10:05 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Deleted volume successfully. Jul 06 12:10:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ae81d4c1-6af2-4fea-af72-74e4e71b48df tempest-VolumesTestJSON-2084595785 None] Lock "cinder-ae2f039f-8fcd-47c2-be21-87459f10d246-delete_volume" released by "delete_volume" :: held 3.718s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661a824d-3644-4770-b9ff-78fced11a762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b458b85-0646-4ebf-82be-6b976f7df4b9', 'volume_name': 'volume-7b458b85-0646-4ebf-82be-6b976f7df4b9', 'volume_size': 1, 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ecb593f86ab340bf8964e10d312ba960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97933bff-80e3-488a-b4fb-cef69b2505d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97933bff-80e3-488a-b4fb-cef69b2505d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6de8e4a-f82c-4612-a466-fe99345fbbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:06 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Volume 7b458b85-0646-4ebf-82be-6b976f7df4b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b458b85-0646-4ebf-82be-6b976f7df4b9', 'volume_size': 1, 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ecb593f86ab340bf8964e10d312ba960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 12:10:06 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Trying to clone 7b458b85-0646-4ebf-82be-6b976f7df4b9 from image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]). {{(pid=86761) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:10:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-e3398a6b-42d8-4454-b986-c579c360c694 req-2fd85482-3f44-4a3b-93e8-a16bec42d274 tempest-ServerActionsTestOtherA-822197278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-e3398a6b-42d8-4454-b986-c579c360c694 req-2fd85482-3f44-4a3b-93e8-a16bec42d274 tempest-ServerActionsTestOtherA-822197278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:07 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f427b8d-9778-4ade-87f3-b9d43337f59c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-e3398a6b-42d8-4454-b986-c579c360c694 req-2fd85482-3f44-4a3b-93e8-a16bec42d274 tempest-ServerActionsTestOtherA-822197278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:07 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732 Jul 06 12:10:07 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:07 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_y3kfl7ucdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:10:07 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Image download 20.69 MB at 20.69 MB/s Jul 06 12:10:07 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e90688-9d35-4a30-b4a5-74b7218d7ec9]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_y3kfl7ucdevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:07 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_y3kfl7ucdevstack@QuobyteHD Jul 06 12:10:07 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:08 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-e3398a6b-42d8-4454-b986-c579c360c694 req-2fd85482-3f44-4a3b-93e8-a16bec42d274 tempest-ServerActionsTestOtherA-822197278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732" returned: 0 in 1.286s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-e3398a6b-42d8-4454-b986-c579c360c694 req-2fd85482-3f44-4a3b-93e8-a16bec42d274 tempest-ServerActionsTestOtherA-822197278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.319s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-e3398a6b-42d8-4454-b986-c579c360c694 req-2fd85482-3f44-4a3b-93e8-a16bec42d274 tempest-ServerActionsTestOtherA-822197278 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-5325f77b-54a7-4396-aa1a-8409859ca732', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de828505-79d8-42bf-a09e-06449cb749e3', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:10:08 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-e3398a6b-42d8-4454-b986-c579c360c694 req-2fd85482-3f44-4a3b-93e8-a16bec42d274 tempest-ServerActionsTestOtherA-822197278 None] attachment_update completed successfully. Jul 06 12:10:08 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_y3kfl7ucdevstack@QuobyteHD" returned: 0 in 1.246s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:08 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Temporary image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 is fetched for user 2d65afc8daac4b9098d540c25d8820c0. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:10:09 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[016145bb-4936-4ed0-b1fc-cd9d3111da84]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_y3kfl7ucdevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:09 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_y3kfl7ucdevstack@QuobyteHD Jul 06 12:10:09 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:09 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_y3kfl7ucdevstack@QuobyteHD" returned: 0 in 0.909s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1096985311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b458b85-0646-4ebf-82be-6b976f7df4b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ebc8076a11454095f396f26dbcf41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:06Z,use_quota=True,user_id='2d65afc8daac4b9098d540c25d8820c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:10:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Creating volume 7b458b85-0646-4ebf-82be-6b976f7df4b9 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:10:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:10:09 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:10:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:09 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 1073741824 Jul 06 12:10:09 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:11 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 1073741824" returned: 0 in 1.257s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:11 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 Jul 06 12:10:11 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:12 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9" returned: 0 in 0.879s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] <== create_volume: return (2230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:10:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:12 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Attempting download of 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}])) to volume 7b458b85-0646-4ebf-82be-6b976f7df4b9. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:10:12 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9352701-7ce6-44e1-88e7-f198d49ef0d6]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_cheu82fy {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:12 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_cheu82fy Jul 06 12:10:12 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:13 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_cheu82fy" returned: 0 in 1.067s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_cheu82fy {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:13 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_cheu82fy Jul 06 12:10:13 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:14 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_cheu82fy" returned: 1 in 1.278s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_cheu82fy' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:10:14 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[397e1fab-42e3-4eed-a4a0-56bfdc145e74]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_y3kfl7ucdevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:14 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_y3kfl7ucdevstack@QuobyteHD Jul 06 12:10:14 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:15 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_y3kfl7ucdevstack@QuobyteHD" returned: 0 in 1.193s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:15 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 was qcow2, converting to raw {{(pid=86761) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:10:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_y3kfl7ucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:15 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_y3kfl7ucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 Jul 06 12:10:15 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:19 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_y3kfl7ucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9" returned: 0 in 4.154s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:19 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_y3kfl7ucdevstack@QuobyteHD, size 112.00 MB, duration 4.16 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:10:19 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Converted 112.00 MB image at 26.95 MB/s Jul 06 12:10:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:20 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 1G Jul 06 12:10:20 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:21 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 1G" returned: 0 in 1.128s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:21 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9aaf89-c2a8-4826-9eaf-e320b712deb6]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:21 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 Jul 06 12:10:21 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:22 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=84,cinder:SELECT=59,cinder:DELETE=6,cinder:INSERT=16 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:10:22 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=58,cinder:INSERT=15,cinder:UPDATE=49,cinder:DELETE=4 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:10:22 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9" returned: 0 in 1.513s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:22 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 Jul 06 12:10:22 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:23 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9" returned: 1 in 1.207s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:10:23 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Downloaded image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}])) to volume 7b458b85-0646-4ebf-82be-6b976f7df4b9 successfully. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:10:23 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Temporary image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 for user 2d65afc8daac4b9098d540c25d8820c0 is deleted. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:10:23 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Marking volume 7b458b85-0646-4ebf-82be-6b976f7df4b9 as bootable. {{(pid=86761) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:10:23 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Copying metadata from image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 to 7b458b85-0646-4ebf-82be-6b976f7df4b9. {{(pid=86761) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:10:23 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Creating volume glance metadata for volume 7b458b85-0646-4ebf-82be-6b976f7df4b9 backed by image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86761) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:10:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6de8e4a-f82c-4612-a466-fe99345fbbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b458b85-0646-4ebf-82be-6b976f7df4b9', 'volume_size': 1, 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ecb593f86ab340bf8964e10d312ba960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7703d30c-a67e-454b-9525-f4465d865f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:24 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Volume volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 (7b458b85-0646-4ebf-82be-6b976f7df4b9): created successfully Jul 06 12:10:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7703d30c-a67e-454b-9525-f4465d865f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Flow 'volume_create_manager' (b23867a7-7279-4822-b89e-6ed05dea3a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:24 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-50deeb5c-4b3d-492a-84e1-ae96203ca0fd tempest-VolumesImageMetadata-1041372664 None] Created volume successfully. Jul 06 12:10:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Acquiring lock "cinder-7b458b85-0646-4ebf-82be-6b976f7df4b9-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:25 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Lock "cinder-7b458b85-0646-4ebf-82be-6b976f7df4b9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:25 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Acquiring lock "cinder-quobyte-7b458b85-0646-4ebf-82be-6b976f7df4b9" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:25 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Lock "cinder-quobyte-7b458b85-0646-4ebf-82be-6b976f7df4b9" acquired by "delete_volume" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:25 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1335a7-dc46-46ec-97ab-fe2c2d1dd06f]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:25 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 Jul 06 12:10:25 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:26 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9" returned: 0 in 0.903s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:26 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 Jul 06 12:10:26 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:27 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9" returned: 1 in 1.083s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:10:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:27 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9 Jul 06 12:10:27 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:28 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-31815d0b-16bd-48d3-989c-82a86f13feea tempest-GroupsV314Test-164328298 None] Group tempest-GroupsV314Test-Group-684360176: creating Jul 06 12:10:28 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-31815d0b-16bd-48d3-989c-82a86f13feea tempest-GroupsV314Test-164328298 None] Group tempest-GroupsV314Test-Group-684360176: created successfully Jul 06 12:10:28 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b458b85-0646-4ebf-82be-6b976f7df4b9" returned: 0 in 1.314s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:28 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Lock "cinder-quobyte-7b458b85-0646-4ebf-82be-6b976f7df4b9" released by "delete_volume" :: held 3.378s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:28 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-31815d0b-16bd-48d3-989c-82a86f13feea tempest-GroupsV314Test-164328298 None] Create group completed successfully. Jul 06 12:10:28 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Created reservations ['2d60499b-4d74-4e5f-90c6-e6f305e35949', 'f836e0bb-8216-48bf-8901-25e813ce8422', '4d5b60e0-85e6-4559-9591-6c111e2f3fc5', '6076ba80-4895-4fbe-8877-22b2312f9c99'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:10:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:28 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:10:28 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:29 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.039s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:29 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:10:29 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Deleted volume successfully. Jul 06 12:10:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c63239ec-0d53-4aed-a9f6-72856a4a7b2b tempest-VolumesImageMetadata-1041372664 None] Lock "cinder-7b458b85-0646-4ebf-82be-6b976f7df4b9-delete_volume" released by "delete_volume" :: held 4.760s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Flow 'volume_create_manager' (071acab9-a2b5-4675-8a38-9fc45e075227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a286976a-17cf-453e-83da-a273b2f5f14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a286976a-17cf-453e-83da-a273b2f5f14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1313241037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68f9d40e-9162-41a0-9424-42bb0ac181f1,host='devstack@QuobyteHD#QuobyteHD',id=6b5715a3-b135-43a2-a40b-4db79b2fbcaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15e89843f394a3d889ed4e80c8804d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:31Z,use_quota=True,user_id='2db97dfd77d64edfa79e2858717cc2c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6e31bb-910e-4c43-b50d-f00e240e4244),volume_type_id=7a6e31bb-910e-4c43-b50d-f00e240e4244)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200dd3c5-0b8e-4c27-90d0-3b3f20f04a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200dd3c5-0b8e-4c27-90d0-3b3f20f04a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703a09e9-11de-4f17-85dd-5094317bef58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703a09e9-11de-4f17-85dd-5094317bef58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b5715a3-b135-43a2-a40b-4db79b2fbcaf', 'volume_name': 'volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28284e7b-6c76-4350-a2a6-0edbc3343226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28284e7b-6c76-4350-a2a6-0edbc3343226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4c841f-a957-40a2-8fba-4096fecf8d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:30 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Volume 6b5715a3-b135-43a2-a40b-4db79b2fbcaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf', 'volume_size': 1} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=68f9d40e-9162-41a0-9424-42bb0ac181f1,created_at=2026-07-06T10:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1313241037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68f9d40e-9162-41a0-9424-42bb0ac181f1,host='devstack@QuobyteHD#QuobyteHD',id=6b5715a3-b135-43a2-a40b-4db79b2fbcaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15e89843f394a3d889ed4e80c8804d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:31Z,use_quota=True,user_id='2db97dfd77d64edfa79e2858717cc2c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6e31bb-910e-4c43-b50d-f00e240e4244),volume_type_id=7a6e31bb-910e-4c43-b50d-f00e240e4244)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Creating volume 6b5715a3-b135-43a2-a40b-4db79b2fbcaf {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:10:30 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:10:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:30 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf 1073741824 Jul 06 12:10:30 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:32 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf 1073741824" returned: 0 in 1.270s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:32 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf Jul 06 12:10:32 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:32 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf" returned: 0 in 0.673s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:10:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4c841f-a957-40a2-8fba-4096fecf8d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3f0aa2-7d66-48c2-9ea2-0cc746342a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:32 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Volume volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf (6b5715a3-b135-43a2-a40b-4db79b2fbcaf): created successfully Jul 06 12:10:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3f0aa2-7d66-48c2-9ea2-0cc746342a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Flow 'volume_create_manager' (071acab9-a2b5-4675-8a38-9fc45e075227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:32 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-8795aabf-bc0c-4c7d-b379-dc5cc0f3354b tempest-GroupsV314Test-164328298 None] Created volume successfully. Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Flow 'volume_create_manager' (3d6043d7-b95a-4555-a769-007a5c02da93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55bbaf1-e5fb-4a48-852d-73073f1f4e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55bbaf1-e5fb-4a48-852d-73073f1f4e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1705787357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c81136-9699-4131-bc5e-381daf60958d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f36e86bf86a407a98a6d93588e383c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:34Z,use_quota=True,user_id='c90ec99bd6ff4895862d0fa4a13aaa45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a07805-c62d-494f-a514-94e6d23a721f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a07805-c62d-494f-a514-94e6d23a721f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61e1197-b773-4807-84f1-17c4fd9f6419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61e1197-b773-4807-84f1-17c4fd9f6419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c81136-9699-4131-bc5e-381daf60958d', 'volume_name': 'volume-35c81136-9699-4131-bc5e-381daf60958d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c7935e-9417-4a9e-ad51-752116f612f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c7935e-9417-4a9e-ad51-752116f612f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d451d42-f527-439b-b4f9-6035fb751d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:33 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Volume 35c81136-9699-4131-bc5e-381daf60958d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c81136-9699-4131-bc5e-381daf60958d', 'volume_size': 1} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1705787357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c81136-9699-4131-bc5e-381daf60958d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f36e86bf86a407a98a6d93588e383c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:34Z,use_quota=True,user_id='c90ec99bd6ff4895862d0fa4a13aaa45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Creating volume 35c81136-9699-4131-bc5e-381daf60958d {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:10:33 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:10:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:33 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d 1073741824 Jul 06 12:10:33 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:34 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d 1073741824" returned: 0 in 0.912s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:34 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d Jul 06 12:10:34 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:35 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d" returned: 0 in 0.644s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:10:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.067s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:35 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Cloning volume 6b5715a3-b135-43a2-a40b-4db79b2fbcaf to volume 36aa4b68-c4fd-4842-8151-24a2a22e83e2 Jul 06 12:10:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d451d42-f527-439b-b4f9-6035fb751d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c81136-9699-4131-bc5e-381daf60958d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1caae82-2667-4fdb-a9e6-12313b3c6a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:35 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Volume volume-35c81136-9699-4131-bc5e-381daf60958d (35c81136-9699-4131-bc5e-381daf60958d): created successfully Jul 06 12:10:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1caae82-2667-4fdb-a9e6-12313b3c6a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Flow 'volume_create_manager' (3d6043d7-b95a-4555-a769-007a5c02da93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Creating offline snapshot 11a39e27-ce88-4ec7-b5c0-cd97d23fff05 of volume 6b5715a3-b135-43a2-a40b-4db79b2fbcaf {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:10:35 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2dac4c8b-2dc5-4933-b843-c79695d8ea17 tempest-SnapshotMetadataTestJSON-1498800545 None] Created volume successfully. Jul 06 12:10:35 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f451ae0-74a5-4b87-8f88-11728373b321]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:35 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf Jul 06 12:10:35 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:36 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf" returned: 0 in 0.924s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:36 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 1G Jul 06 12:10:36 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:37 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 1G" returned: 0 in 1.125s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:37 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 Jul 06 12:10:37 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:38 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05" returned: 0 in 1.236s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:38 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:10:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:38 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 Jul 06 12:10:38 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:39 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05" returned: 0 in 0.738s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:39 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.info Jul 06 12:10:39 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:40 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.info" returned: 0 in 0.721s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:40 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:10:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:40 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.info Jul 06 12:10:40 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:41 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.info" returned: 0 in 0.838s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Acquiring lock "cinder-quobyte-36aa4b68-c4fd-4842-8151-24a2a22e83e2" by "_copy_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Lock "cinder-quobyte-36aa4b68-c4fd-4842-8151-24a2a22e83e2" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] snapshot: 11a39e27-ce88-4ec7-b5c0-cd97d23fff05, volume: 36aa4b68-c4fd-4842-8151-24a2a22e83e2, {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:10:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:41 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5af64c-7aec-4d4b-867c-13c9b48cf0c6]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:41 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 Jul 06 12:10:41 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:42 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-384144f5-8209-450e-86fe-45c2c8488abb req-4f75da62-3518-4c10-a394-3511cea55307 tempest-ServerActionsTestOtherA-822197278 None] Terminate volume connection completed successfully. Jul 06 12:10:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-384144f5-8209-450e-86fe-45c2c8488abb req-4f75da62-3518-4c10-a394-3511cea55307 tempest-ServerActionsTestOtherA-822197278 None] Deleting attachment de828505-79d8-42bf-a09e-06449cb749e3. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:10:42 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05" returned: 0 in 0.847s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:10:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:10:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Creating direct copy from snapshot {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:10:42 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93fcdbf-7fd8-49fe-b65b-a1e8ba57e860]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:42 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf Jul 06 12:10:42 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:43 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf" returned: 0 in 1.094s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:43 devstack cinder-volume[86761]: DEBUG cinder.utils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Path /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-36aa4b68-c4fd-4842-8151-24a2a22e83e2 not found in is_blk_device check {{(pid=86761) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:10:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-36aa4b68-c4fd-4842-8151-24a2a22e83e2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:43 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-36aa4b68-c4fd-4842-8151-24a2a22e83e2 Jul 06 12:10:43 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:51 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-36aa4b68-c4fd-4842-8151-24a2a22e83e2" returned: 0 in 8.621s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:51 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[599d6ae0-1571-463d-ab86-dcb57f667dd0]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:52 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=24,cinder:INSERT=9,cinder:UPDATE=14,cinder:DELETE=3 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:10:52 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=22,cinder:SELECT=24,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:10:52 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf Jul 06 12:10:52 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:10:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:52 devstack sudo[91626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:10:52 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:53 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf" returned: 0 in 1.256s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:53 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf, size 1024.00 MB, duration 8.62 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-36aa4b68-c4fd-4842-8151-24a2a22e83e2 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:10:53 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Converted 1024.00 MB image at 118.76 MB/s Jul 06 12:10:53 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-36aa4b68-c4fd-4842-8151-24a2a22e83e2 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:10:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-36aa4b68-c4fd-4842-8151-24a2a22e83e2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:53 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-36aa4b68-c4fd-4842-8151-24a2a22e83e2 Jul 06 12:10:53 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:53 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.435s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:10:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:10:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:10:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:10:54 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-36aa4b68-c4fd-4842-8151-24a2a22e83e2" returned: 0 in 0.958s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Lock "cinder-quobyte-36aa4b68-c4fd-4842-8151-24a2a22e83e2" released by "_copy_volume_from_snapshot" :: held 12.940s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Acquiring lock "cinder-quobyte-11a39e27-ce88-4ec7-b5c0-cd97d23fff05" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Lock "cinder-quobyte-11a39e27-ce88-4ec7-b5c0-cd97d23fff05" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Deleting offline snapshot 11a39e27-ce88-4ec7-b5c0-cd97d23fff05 of volume 6b5715a3-b135-43a2-a40b-4db79b2fbcaf {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:10:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] snapshot_file for this snap is: volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:10:54 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b27076-7147-4e14-be18-1f22bd0fd0da]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:54 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 Jul 06 12:10:54 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:55 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05" returned: 0 in 0.974s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:10:55 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a929cb-1015-4a22-9bfa-ee6aeba09a6a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:55 devstack sudo[91644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf Jul 06 12:10:55 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:56 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf" returned: 0 in 0.867s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:56 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 Jul 06 12:10:56 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:57 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05" returned: 0 in 0.963s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:57 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05 Jul 06 12:10:57 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Acquiring lock "cinder-5325f77b-54a7-4396-aa1a-8409859ca732-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Lock "cinder-5325f77b-54a7-4396-aa1a-8409859ca732-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Acquiring lock "cinder-quobyte-5325f77b-54a7-4396-aa1a-8409859ca732" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Lock "cinder-quobyte-5325f77b-54a7-4396-aa1a-8409859ca732" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:57 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4272a67-dfe0-402a-9bc5-d2fa0f028931]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:57 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732 Jul 06 12:10:57 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:57 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf.11a39e27-ce88-4ec7-b5c0-cd97d23fff05" returned: 0 in 0.830s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Lock "cinder-quobyte-11a39e27-ce88-4ec7-b5c0-cd97d23fff05" released by "_delete_snapshot" :: held 3.764s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.558s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 21.852s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] Creating offline snapshot 228e0ea6-1dab-4a00-afc9-070931da44be of volume 35c81136-9699-4131-bc5e-381daf60958d {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:10:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e59fb9-691f-428a-a9d0-52b359b4ec1e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:58 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4205a635-47cc-425f-befc-f30ef47a95d0 tempest-GroupsV314Test-164328298 None] Create group from source-group-68f9d40e-9162-41a0-9424-42bb0ac181f1 completed successfully. Jul 06 12:10:58 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d Jul 06 12:10:58 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:58 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732" returned: 0 in 0.863s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:58 devstack sudo[91666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732 Jul 06 12:10:58 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:59 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d" returned: 0 in 0.953s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:59 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be 1G Jul 06 12:10:59 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:59 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5325f77b-54a7-4396-aa1a-8409859ca732" returned: 0 in 0.746s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Lock "cinder-quobyte-5325f77b-54a7-4396-aa1a-8409859ca732" released by "delete_volume" :: held 1.667s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:59 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Created reservations ['87cf0497-aa67-463a-8e01-ab29ae68d552', '45e0576d-2c0b-40c5-9f31-3793cc48df8b', 'ebdc5ac5-55cf-47ba-8d02-f7edc9f03395', '606d6526-09da-4b9b-8f2a-86401ca8c64f'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:10:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:59 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:10:59 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Acquiring lock "cinder-quobyte-36aa4b68-c4fd-4842-8151-24a2a22e83e2" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Lock "cinder-quobyte-36aa4b68-c4fd-4842-8151-24a2a22e83e2" acquired by "delete_volume" :: waited 0.039s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:00 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[315b5fef-e639-4dcd-8fec-bed81f6fdb5d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-36aa4b68-c4fd-4842-8151-24a2a22e83e2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:00 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-36aa4b68-c4fd-4842-8151-24a2a22e83e2 Jul 06 12:11:00 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:00 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.187s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:00 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:00 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Deleted volume successfully. Jul 06 12:11:00 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be 1G" returned: 0 in 1.630s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35c81136-9699-4131-bc5e-381daf60958d -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5250059c-20ad-4fd4-ba24-0f8464b2e06e tempest-ServerActionsTestOtherA-822197278 None] Lock "cinder-5325f77b-54a7-4396-aa1a-8409859ca732-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:00 devstack sudo[91711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35c81136-9699-4131-bc5e-381daf60958d -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be Jul 06 12:11:00 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:01 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-36aa4b68-c4fd-4842-8151-24a2a22e83e2" returned: 0 in 1.194s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-36aa4b68-c4fd-4842-8151-24a2a22e83e2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:01 devstack sudo[91719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-36aa4b68-c4fd-4842-8151-24a2a22e83e2 Jul 06 12:11:01 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:01 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35c81136-9699-4131-bc5e-381daf60958d -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be" returned: 0 in 0.861s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:01 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be is being set with open permissions: ugo+rw Jul 06 12:11:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:01 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be Jul 06 12:11:01 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:02 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-36aa4b68-c4fd-4842-8151-24a2a22e83e2" returned: 0 in 1.023s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Lock "cinder-quobyte-36aa4b68-c4fd-4842-8151-24a2a22e83e2" released by "delete_volume" :: held 2.328s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:02 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Created reservations ['895bab65-ec18-4288-b897-06093252fe38'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:02 devstack cinder-volume[86761]: WARNING cinder.quota [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1613861220 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1613861220, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:11:02 devstack cinder-volume[86761]: WARNING cinder.quota [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1613861220 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1613861220, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:11:02 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be" returned: 0 in 0.996s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:02 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Created reservations ['2c4ee8bc-a9c9-4b8b-93e0-695b76106abb', '142f9276-32c2-449a-9e5e-c84c9ea7d4e8', 'a0b80056-6d2d-4e20-8d58-24531027cfc6', '3a01daa9-d5b0-403d-a5bb-de584e465f45'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:02 devstack sudo[91750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.info Jul 06 12:11:02 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:02 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:02 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:02 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:11:02 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:03 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.info" returned: 0 in 0.814s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:03 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.info is being set with open permissions: ugo+rw Jul 06 12:11:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:03 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.info Jul 06 12:11:03 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:03 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.008s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:03 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:03 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-5c97d05c-8fc1-43c8-9ba1-e0ef648cc870 tempest-GroupsV314Test-164328298 None] Delete group completed successfully. Jul 06 12:11:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] Acquiring lock "cinder-quobyte-6b5715a3-b135-43a2-a40b-4db79b2fbcaf" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] Lock "cinder-quobyte-6b5715a3-b135-43a2-a40b-4db79b2fbcaf" acquired by "delete_volume" :: waited 0.027s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:04 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e6e560-e825-4ff0-85b4-76fc0d696eff]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:04 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.info" returned: 0 in 0.989s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.414s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:04 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f0c2d935-f910-4a8d-ab87-c3a875c9574a tempest-SnapshotMetadataTestJSON-1498800545 None] Create snapshot completed successfully Jul 06 12:11:04 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf Jul 06 12:11:04 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:05 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf" returned: 0 in 0.855s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:05 devstack sudo[91769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf Jul 06 12:11:05 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:06 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6b5715a3-b135-43a2-a40b-4db79b2fbcaf" returned: 0 in 0.991s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] Lock "cinder-quobyte-6b5715a3-b135-43a2-a40b-4db79b2fbcaf" released by "delete_volume" :: held 1.968s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] Created reservations ['3faf947d-6dd6-4854-bc1e-ddf39182ce02'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] Created reservations ['986defc3-42ca-499e-82e0-1c5338d643ba', '73c5fe6b-dfef-4bc5-98ff-db64a4075d9c', '38ee3a5e-cf60-4b58-8ff2-211e498c5b6a', 'd96d755b-a5e3-4894-82f8-fefdda84fe03'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Acquiring lock "cinder-228e0ea6-1dab-4a00-afc9-070931da44be-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "cinder-228e0ea6-1dab-4a00-afc9-070931da44be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Acquiring lock "cinder-quobyte-35c81136-9699-4131-bc5e-381daf60958d" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "cinder-quobyte-35c81136-9699-4131-bc5e-381daf60958d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Acquiring lock "cinder-quobyte-228e0ea6-1dab-4a00-afc9-070931da44be" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "cinder-quobyte-228e0ea6-1dab-4a00-afc9-070931da44be" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Deleting offline snapshot 228e0ea6-1dab-4a00-afc9-070931da44be of volume 35c81136-9699-4131-bc5e-381daf60958d {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] snapshot_file for this snap is: volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05b7dd1-befe-4213-9a7e-75d9f197c886]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:06 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:11:06 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:06 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be Jul 06 12:11:06 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:07 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.951s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:07 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:07 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6e86db53-d6a2-45ff-99b7-bf913a83d466 tempest-GroupsV314Test-164328298 None] Delete group completed successfully. Jul 06 12:11:07 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be" returned: 0 in 1.131s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35c81136-9699-4131-bc5e-381daf60958d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:11:07 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[edce68e2-c957-4dd2-8220-322197525d52]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:07 devstack sudo[91780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d Jul 06 12:11:07 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:08 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d" returned: 0 in 1.080s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:08 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be Jul 06 12:11:08 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:09 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be" returned: 0 in 0.926s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:09 devstack sudo[91791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be Jul 06 12:11:09 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:10 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d.228e0ea6-1dab-4a00-afc9-070931da44be" returned: 0 in 0.990s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "cinder-quobyte-228e0ea6-1dab-4a00-afc9-070931da44be" released by "_delete_snapshot" :: held 4.306s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "cinder-quobyte-35c81136-9699-4131-bc5e-381daf60958d" released by "delete_snapshot" :: held 4.337s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:10 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Created reservations ['6c53da8e-08ce-4b75-b267-78a1a7326002', '2a331bc0-4580-476f-a26b-f45277ecb53d', '8f1d8dbc-adef-4c5b-97f5-5afed567e506', '65003ba3-1916-4f4b-b0b1-7c7e997831d5'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:11 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Delete snapshot completed successfully. Jul 06 12:11:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c49cba60-30ae-4392-ac06-788793491a6b tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "cinder-228e0ea6-1dab-4a00-afc9-070931da44be-delete_snapshot" released by "delete_snapshot" :: held 4.549s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Acquiring lock "cinder-35c81136-9699-4131-bc5e-381daf60958d-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "cinder-35c81136-9699-4131-bc5e-381daf60958d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Acquiring lock "cinder-quobyte-35c81136-9699-4131-bc5e-381daf60958d" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "cinder-quobyte-35c81136-9699-4131-bc5e-381daf60958d" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:12 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ae8712-e64c-4438-a538-eb87e85bb348]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:12 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d Jul 06 12:11:12 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:13 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d" returned: 0 in 1.023s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:13 devstack sudo[91802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d Jul 06 12:11:13 devstack sudo[91802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:13 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-07adfb35-cba3-4be2-86dd-186e010bf8b0 tempest-GroupsV320Test-1928766619 None] Group tempest-GroupsV320Test-Group-207489179: creating Jul 06 12:11:13 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-07adfb35-cba3-4be2-86dd-186e010bf8b0 tempest-GroupsV320Test-1928766619 None] Group tempest-GroupsV320Test-Group-207489179: created successfully Jul 06 12:11:13 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-07adfb35-cba3-4be2-86dd-186e010bf8b0 tempest-GroupsV320Test-1928766619 None] Create group completed successfully. Jul 06 12:11:14 devstack sudo[91802]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35c81136-9699-4131-bc5e-381daf60958d" returned: 0 in 1.002s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "cinder-quobyte-35c81136-9699-4131-bc5e-381daf60958d" released by "delete_volume" :: held 2.114s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Created reservations ['0e25b155-32e4-48c3-8530-afaf741ca636', 'ae727774-b674-4037-bfa3-b19036d029d7', '1bdc1503-fa1c-4184-8281-94513ef12404', 'ea069d82-d1d6-4ce8-bcc4-aa1ae260723a'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:14 devstack sudo[91807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:11:14 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Flow 'volume_create_manager' (c449ee79-bd6d-45f9-b8f7-dbe93442ab5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82692dce-1f9e-4e23-bf80-a1888e7bbff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82692dce-1f9e-4e23-bf80-a1888e7bbff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-850086317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e115ddc-c941-4391-9f78-834bb78dc099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687f2582fd0d455988ddb9c52f8b7642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:14Z,use_quota=True,user_id='b6d38b6f4a9c422fa9857cc0c6137364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da26488a-85db-45c1-b670-029a41536b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da26488a-85db-45c1-b670-029a41536b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9833ddd1-3dc7-4101-9f62-779bcdf2478c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9833ddd1-3dc7-4101-9f62-779bcdf2478c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e115ddc-c941-4391-9f78-834bb78dc099', 'volume_name': 'volume-7e115ddc-c941-4391-9f78-834bb78dc099', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7ae7c6-8b68-47c0-b416-e158923d1155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7ae7c6-8b68-47c0-b416-e158923d1155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce6275b-33b4-4a6a-9a3a-a04c8bafb652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:14 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Volume 7e115ddc-c941-4391-9f78-834bb78dc099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e115ddc-c941-4391-9f78-834bb78dc099', 'volume_size': 1} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-850086317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e115ddc-c941-4391-9f78-834bb78dc099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687f2582fd0d455988ddb9c52f8b7642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:14Z,use_quota=True,user_id='b6d38b6f4a9c422fa9857cc0c6137364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Creating volume 7e115ddc-c941-4391-9f78-834bb78dc099 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:11:14 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:11:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7e115ddc-c941-4391-9f78-834bb78dc099 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:14 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7e115ddc-c941-4391-9f78-834bb78dc099 1073741824 Jul 06 12:11:14 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:15 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.884s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:15 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:15 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Deleted volume successfully. Jul 06 12:11:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1b2cd892-b1ea-401f-937e-f5669302a2e4 tempest-SnapshotMetadataTestJSON-1498800545 None] Lock "cinder-35c81136-9699-4131-bc5e-381daf60958d-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:15 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-f241867d-e9f1-4366-9ff8-b9529b6a373d tempest-GroupsV320Test-1928766619 None] Created reservations ['2493322c-c7fd-45e1-8958-a375a9c219d6'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f241867d-e9f1-4366-9ff8-b9529b6a373d tempest-GroupsV320Test-1928766619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f241867d-e9f1-4366-9ff8-b9529b6a373d tempest-GroupsV320Test-1928766619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f241867d-e9f1-4366-9ff8-b9529b6a373d tempest-GroupsV320Test-1928766619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f241867d-e9f1-4366-9ff8-b9529b6a373d tempest-GroupsV320Test-1928766619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f241867d-e9f1-4366-9ff8-b9529b6a373d tempest-GroupsV320Test-1928766619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f241867d-e9f1-4366-9ff8-b9529b6a373d tempest-GroupsV320Test-1928766619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:15 devstack sudo[91817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:11:15 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:15 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7e115ddc-c941-4391-9f78-834bb78dc099 1073741824" returned: 0 in 1.441s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7e115ddc-c941-4391-9f78-834bb78dc099 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:16 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7e115ddc-c941-4391-9f78-834bb78dc099 Jul 06 12:11:16 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:16 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f241867d-e9f1-4366-9ff8-b9529b6a373d tempest-GroupsV320Test-1928766619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.814s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:16 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-f241867d-e9f1-4366-9ff8-b9529b6a373d tempest-GroupsV320Test-1928766619 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:16 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f241867d-e9f1-4366-9ff8-b9529b6a373d tempest-GroupsV320Test-1928766619 None] Delete group completed successfully. Jul 06 12:11:16 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7e115ddc-c941-4391-9f78-834bb78dc099" returned: 0 in 0.890s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] <== create_volume: return (2390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:11:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.392s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce6275b-33b4-4a6a-9a3a-a04c8bafb652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e115ddc-c941-4391-9f78-834bb78dc099', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd06cc6d-11f3-461a-b662-3002c4a0eead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:16 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Volume volume-7e115ddc-c941-4391-9f78-834bb78dc099 (7e115ddc-c941-4391-9f78-834bb78dc099): created successfully Jul 06 12:11:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd06cc6d-11f3-461a-b662-3002c4a0eead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Flow 'volume_create_manager' (c449ee79-bd6d-45f9-b8f7-dbe93442ab5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:16 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0feb33ba-4ffd-4b40-af1a-9d5f5fa7403d tempest-AttachVolumeShelveTestJSON-406136481 None] Created volume successfully. Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Flow 'volume_create_manager' (88ce957b-7a2c-40b5-a5cf-4056acfdb560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983c4577-b255-4ee2-bf69-e14bb8bff51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983c4577-b255-4ee2-bf69-e14bb8bff51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1056381252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f56dfa-194e-4d65-a0a8-bbea456f669c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7768f272a27496d9f42dc8103947d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:21Z,use_quota=True,user_id='67e8e0adee8f464493116e351ae15328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c18f56c-fd4f-421f-aa3e-417ef0e7a061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c18f56c-fd4f-421f-aa3e-417ef0e7a061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87bafeed-7a9d-45d6-97a6-a73b645882c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87bafeed-7a9d-45d6-97a6-a73b645882c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4f56dfa-194e-4d65-a0a8-bbea456f669c', 'volume_name': 'volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56853f8d-2f68-40fc-8c6a-8be4f1b1c001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56853f8d-2f68-40fc-8c6a-8be4f1b1c001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8db938-cb10-4d68-95c2-4aafcb4b18ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:21 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Volume a4f56dfa-194e-4d65-a0a8-bbea456f669c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c', 'volume_size': 1} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1056381252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f56dfa-194e-4d65-a0a8-bbea456f669c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7768f272a27496d9f42dc8103947d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:21Z,use_quota=True,user_id='67e8e0adee8f464493116e351ae15328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Creating volume a4f56dfa-194e-4d65-a0a8-bbea456f669c {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:11:21 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:11:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:21 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c 1073741824 Jul 06 12:11:21 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:22 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c 1073741824" returned: 0 in 1.193s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:22 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c Jul 06 12:11:22 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:23 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c" returned: 0 in 0.788s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:11:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8db938-cb10-4d68-95c2-4aafcb4b18ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89ce68c-f081-47f0-9a6c-cdc5d62d229f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:23 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Volume volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c (a4f56dfa-194e-4d65-a0a8-bbea456f669c): created successfully Jul 06 12:11:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89ce68c-f081-47f0-9a6c-cdc5d62d229f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Flow 'volume_create_manager' (88ce957b-7a2c-40b5-a5cf-4056acfdb560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:23 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-5df5fd04-b8d4-42f1-9c87-f1d32a770f40 tempest-AbsoluteLimitsTests-2025401036 None] Created volume successfully. Jul 06 12:11:25 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Acquiring lock "cinder-a4f56dfa-194e-4d65-a0a8-bbea456f669c-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:25 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Lock "cinder-a4f56dfa-194e-4d65-a0a8-bbea456f669c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:25 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Acquiring lock "cinder-quobyte-a4f56dfa-194e-4d65-a0a8-bbea456f669c" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:25 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Lock "cinder-quobyte-a4f56dfa-194e-4d65-a0a8-bbea456f669c" acquired by "delete_volume" :: waited 0.036s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:25 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79a5136-7a1d-46a2-beee-9676cef876b3]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:25 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c Jul 06 12:11:25 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:26 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c" returned: 0 in 1.161s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:26 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c Jul 06 12:11:26 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:27 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a4f56dfa-194e-4d65-a0a8-bbea456f669c" returned: 0 in 0.943s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Lock "cinder-quobyte-a4f56dfa-194e-4d65-a0a8-bbea456f669c" released by "delete_volume" :: held 2.196s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:27 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Created reservations ['ea791e7f-cb5d-4794-ac41-735c78ccfe2b', 'c20b4f53-5737-4df7-8345-da16b78f1b94', 'be79bee1-4f32-4af0-b678-ae8d381677c9', 'cf254160-6a52-4603-9524-1c564a3316e8'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:27 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:11:27 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:28 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.090s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:28 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:28 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Deleted volume successfully. Jul 06 12:11:28 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2d4e7ad3-476c-4138-93ee-4bf768397f78 tempest-AbsoluteLimitsTests-2025401036 None] Lock "cinder-a4f56dfa-194e-4d65-a0a8-bbea456f669c-delete_volume" released by "delete_volume" :: held 3.743s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:37 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=52,cinder:UPDATE=59,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Flow 'volume_create_manager' (cd8616ae-c3d1-4644-adc1-0ab32f039c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94243d57-4a75-49a3-acf3-5933105b6f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94243d57-4a75-49a3-acf3-5933105b6f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1245863932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676f6733-c914-4076-a1ee-3f35adc0c7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b460cdd04fa34afba6967a3918dd067b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:38Z,use_quota=True,user_id='2030b2a027f541ec819c3dad992a7516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a5c014-b436-4720-b588-b2885ee181b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a5c014-b436-4720-b588-b2885ee181b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc8977e-18d6-42ef-9f2d-6deff9d1fea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc8977e-18d6-42ef-9f2d-6deff9d1fea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676f6733-c914-4076-a1ee-3f35adc0c7bb', 'volume_name': 'volume-676f6733-c914-4076-a1ee-3f35adc0c7bb', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d977e0cd-3ebd-4866-a079-cb3c1443c472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d977e0cd-3ebd-4866-a079-cb3c1443c472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73b652a-f88e-4100-a4bc-2a3bec0528d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:38 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Volume 676f6733-c914-4076-a1ee-3f35adc0c7bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676f6733-c914-4076-a1ee-3f35adc0c7bb', 'volume_size': 1} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1245863932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676f6733-c914-4076-a1ee-3f35adc0c7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b460cdd04fa34afba6967a3918dd067b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:38Z,use_quota=True,user_id='2030b2a027f541ec819c3dad992a7516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Creating volume 676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:11:38 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:38 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb 1073741824 Jul 06 12:11:38 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Flow 'volume_create_manager' (f7a03fa2-bef6-4b1a-a16a-7e7fde8bd8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0752e96-cadd-4f7a-85cd-d45628e67c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0752e96-cadd-4f7a-85cd-d45628e67c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-579091640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80006433-2ecf-487c-8ead-f48c0ae0b702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb894769e244d2885b2d01db040c42d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:39Z,use_quota=True,user_id='4bb93e55ec52417cb7966e7893540a59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e1e708-1dee-4fc5-81c7-827d7ab40979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e1e708-1dee-4fc5-81c7-827d7ab40979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27eef25-2d84-4f25-8039-085e1ab81ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27eef25-2d84-4f25-8039-085e1ab81ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80006433-2ecf-487c-8ead-f48c0ae0b702', 'volume_name': 'volume-80006433-2ecf-487c-8ead-f48c0ae0b702', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f22b37-76e1-4c62-ab48-bfd6929caff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f22b37-76e1-4c62-ab48-bfd6929caff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12db2f65-8438-499e-8bda-b74bdeb251bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:38 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Volume 80006433-2ecf-487c-8ead-f48c0ae0b702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80006433-2ecf-487c-8ead-f48c0ae0b702', 'volume_size': 1} Jul 06 12:11:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-2bb8c77f-f6bd-49b6-967d-c5be82d6ac31 req-ae613791-0d5d-4e94-b989-efa7df873929 tempest-AttachVolumeShelveTestJSON-406136481 None] No connector for attachment 09c15786-874a-429c-ab0d-6f3e8820946a; skipping storage backend terminate_connection call. {{(pid=86761) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 06 12:11:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-2bb8c77f-f6bd-49b6-967d-c5be82d6ac31 req-ae613791-0d5d-4e94-b989-efa7df873929 tempest-AttachVolumeShelveTestJSON-406136481 None] Deleting attachment 09c15786-874a-429c-ab0d-6f3e8820946a. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:11:39 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb 1073741824" returned: 0 in 1.418s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:39 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb Jul 06 12:11:39 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:40 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb" returned: 0 in 0.739s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] <== create_volume: return (2226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.229s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.677s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-579091640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80006433-2ecf-487c-8ead-f48c0ae0b702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb894769e244d2885b2d01db040c42d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:39Z,use_quota=True,user_id='4bb93e55ec52417cb7966e7893540a59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Creating volume 80006433-2ecf-487c-8ead-f48c0ae0b702 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:11:40 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:40 devstack sudo[91944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702 1073741824 Jul 06 12:11:40 devstack sudo[91944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73b652a-f88e-4100-a4bc-2a3bec0528d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676f6733-c914-4076-a1ee-3f35adc0c7bb', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c241d2-3de6-4150-91d2-639ea6cff9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:40 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Volume volume-676f6733-c914-4076-a1ee-3f35adc0c7bb (676f6733-c914-4076-a1ee-3f35adc0c7bb): created successfully Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c241d2-3de6-4150-91d2-639ea6cff9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Flow 'volume_create_manager' (cd8616ae-c3d1-4644-adc1-0ab32f039c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a5b93810-f682-432f-b1af-6cd4aade2773 tempest-SnapshotsActionsTest-1039763116 None] Created volume successfully. Jul 06 12:11:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:41 devstack sudo[91944]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702 1073741824" returned: 0 in 1.084s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:41 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702 Jul 06 12:11:41 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:42 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702" returned: 0 in 0.742s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:11:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.861s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12db2f65-8438-499e-8bda-b74bdeb251bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80006433-2ecf-487c-8ead-f48c0ae0b702', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa0843a-fa28-4858-bedc-3391d3e8f32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] Creating offline snapshot cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 of volume 676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:11:42 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Volume volume-80006433-2ecf-487c-8ead-f48c0ae0b702 (80006433-2ecf-487c-8ead-f48c0ae0b702): created successfully Jul 06 12:11:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa0843a-fa28-4858-bedc-3391d3e8f32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Flow 'volume_create_manager' (f7a03fa2-bef6-4b1a-a16a-7e7fde8bd8a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:42 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbea9f8-327a-47f2-a827-6db3b67fdd6a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:42 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-5edeba38-8721-4334-9c52-86ba3e95fbd7 tempest-VolumesDeleteCascade-969775107 None] Created volume successfully. Jul 06 12:11:42 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb Jul 06 12:11:42 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:43 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb" returned: 0 in 0.911s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:43 devstack sudo[91969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 1G Jul 06 12:11:43 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:44 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 1G" returned: 0 in 1.102s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676f6733-c914-4076-a1ee-3f35adc0c7bb -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:44 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676f6733-c914-4076-a1ee-3f35adc0c7bb -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 Jul 06 12:11:44 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:45 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676f6733-c914-4076-a1ee-3f35adc0c7bb -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" returned: 0 in 0.895s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:45 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 is being set with open permissions: ugo+rw Jul 06 12:11:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:45 devstack sudo[91989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 Jul 06 12:11:45 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:46 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" returned: 0 in 0.747s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:46 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.info Jul 06 12:11:46 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:46 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.info" returned: 0 in 0.750s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:46 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.info is being set with open permissions: ugo+rw Jul 06 12:11:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:46 devstack sudo[92006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.info Jul 06 12:11:46 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:47 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.info" returned: 0 in 0.746s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.310s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.650s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] Creating offline snapshot e28eabdc-1e10-46fc-b175-5a225b771e46 of volume 80006433-2ecf-487c-8ead-f48c0ae0b702 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:11:47 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-8e2bc79e-7f1c-4fcf-8b86-f4b09d8d6cd1 tempest-SnapshotsActionsTest-1039763116 None] Create snapshot completed successfully Jul 06 12:11:47 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[838fc6f3-06e9-40a4-b3a5-8dcdb0e496b4]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:47 devstack sudo[92012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702 Jul 06 12:11:47 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:48 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702" returned: 0 in 0.978s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:48 devstack sudo[92019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 1G Jul 06 12:11:48 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d2aea818-70d5-4f77-b5a3-9c4848b5bedd tempest-SnapshotsActionsTest-1039763116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:50 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 1G" returned: 0 in 1.493s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80006433-2ecf-487c-8ead-f48c0ae0b702 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:50 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80006433-2ecf-487c-8ead-f48c0ae0b702 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 Jul 06 12:11:50 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:51 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80006433-2ecf-487c-8ead-f48c0ae0b702 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46" returned: 0 in 0.805s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:51 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 is being set with open permissions: ugo+rw Jul 06 12:11:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:51 devstack sudo[92088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 Jul 06 12:11:51 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:52 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46" returned: 0 in 1.194s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:52 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=79,cinder:SELECT=62,cinder:INSERT=19,cinder:DELETE=4 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:11:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:52 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.info Jul 06 12:11:52 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:11:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:52 devstack sudo[92106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:11:52 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:53 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.info" returned: 0 in 0.991s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:53 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.info is being set with open permissions: ugo+rw Jul 06 12:11:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:53 devstack sudo[92111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.info Jul 06 12:11:53 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:53 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.415s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:11:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:11:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:11:54 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.info" returned: 0 in 1.056s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.674s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d2aea818-70d5-4f77-b5a3-9c4848b5bedd tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.515s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d2aea818-70d5-4f77-b5a3-9c4848b5bedd tempest-SnapshotsActionsTest-1039763116 None] Creating offline snapshot 0f1a6c26-f4d7-41b4-aacb-24899f66847e of volume 676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:11:54 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-facd7fef-7af1-4458-b42d-d3cc7652263d tempest-VolumesDeleteCascade-969775107 None] Create snapshot completed successfully Jul 06 12:11:54 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed64fdf0-1049-4127-92b8-b98370932fa5]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2aea818-70d5-4f77-b5a3-9c4848b5bedd tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:54 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 Jul 06 12:11:54 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ac9e074b-e430-45e1-b5cc-2479e0a504d9 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:55 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2aea818-70d5-4f77-b5a3-9c4848b5bedd tempest-SnapshotsActionsTest-1039763116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" returned: 0 in 1.260s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d2aea818-70d5-4f77-b5a3-9c4848b5bedd tempest-SnapshotsActionsTest-1039763116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676f6733-c914-4076-a1ee-3f35adc0c7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:11:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2aea818-70d5-4f77-b5a3-9c4848b5bedd tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:55 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e 1G Jul 06 12:11:55 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:57 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2aea818-70d5-4f77-b5a3-9c4848b5bedd tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e 1G" returned: 0 in 1.558s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2aea818-70d5-4f77-b5a3-9c4848b5bedd tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:57 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e Jul 06 12:11:57 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:58 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2aea818-70d5-4f77-b5a3-9c4848b5bedd tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e" returned: 0 in 0.797s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:58 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-d2aea818-70d5-4f77-b5a3-9c4848b5bedd tempest-SnapshotsActionsTest-1039763116 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e is being set with open permissions: ugo+rw Jul 06 12:11:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2aea818-70d5-4f77-b5a3-9c4848b5bedd tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:58 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e Jul 06 12:11:58 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:59 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2aea818-70d5-4f77-b5a3-9c4848b5bedd tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e" returned: 0 in 1.041s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d2aea818-70d5-4f77-b5a3-9c4848b5bedd tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.917s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ac9e074b-e430-45e1-b5cc-2479e0a504d9 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.929s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ac9e074b-e430-45e1-b5cc-2479e0a504d9 tempest-VolumesDeleteCascade-969775107 None] Creating offline snapshot 87004828-b292-4643-b2fa-2e228803e6f7 of volume 80006433-2ecf-487c-8ead-f48c0ae0b702 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:11:59 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d2aea818-70d5-4f77-b5a3-9c4848b5bedd tempest-SnapshotsActionsTest-1039763116 None] Create snapshot completed successfully Jul 06 12:11:59 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a42d57-5bb1-4afd-9d7d-409457e353fa]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac9e074b-e430-45e1-b5cc-2479e0a504d9 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:59 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 Jul 06 12:11:59 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Acquiring lock "cinder-0f1a6c26-f4d7-41b4-aacb-24899f66847e-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-0f1a6c26-f4d7-41b4-aacb-24899f66847e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Acquiring lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Acquiring lock "cinder-quobyte-0f1a6c26-f4d7-41b4-aacb-24899f66847e" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-0f1a6c26-f4d7-41b4-aacb-24899f66847e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Deleting offline snapshot 0f1a6c26-f4d7-41b4-aacb-24899f66847e of volume 676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:12:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] snapshot_file for this snap is: volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:12:00 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cbe129-0cfc-4172-9e0c-17ce2aefce69]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:00 devstack sudo[92218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e Jul 06 12:12:00 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:00 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac9e074b-e430-45e1-b5cc-2479e0a504d9 tempest-VolumesDeleteCascade-969775107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46" returned: 0 in 1.205s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ac9e074b-e430-45e1-b5cc-2479e0a504d9 tempest-VolumesDeleteCascade-969775107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80006433-2ecf-487c-8ead-f48c0ae0b702(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac9e074b-e430-45e1-b5cc-2479e0a504d9 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:00 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7 1G Jul 06 12:12:00 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:01 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e" returned: 0 in 1.223s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676f6733-c914-4076-a1ee-3f35adc0c7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:01 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f663669-b716-4a25-a0bb-a343e054106d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:01 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 Jul 06 12:12:01 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:02 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac9e074b-e430-45e1-b5cc-2479e0a504d9 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7 1G" returned: 0 in 1.997s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac9e074b-e430-45e1-b5cc-2479e0a504d9 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:02 devstack sudo[92257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7 Jul 06 12:12:02 devstack sudo[92257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:03 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" returned: 0 in 1.752s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676f6733-c914-4076-a1ee-3f35adc0c7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:03 devstack sudo[92263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e Jul 06 12:12:03 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:04 devstack sudo[92257]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac9e074b-e430-45e1-b5cc-2479e0a504d9 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7" returned: 0 in 1.329s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:04 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-ac9e074b-e430-45e1-b5cc-2479e0a504d9 tempest-VolumesDeleteCascade-969775107 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7 is being set with open permissions: ugo+rw Jul 06 12:12:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac9e074b-e430-45e1-b5cc-2479e0a504d9 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:04 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7 Jul 06 12:12:04 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:04 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e" returned: 0 in 1.346s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:04 devstack sudo[92275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e Jul 06 12:12:04 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:04 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac9e074b-e430-45e1-b5cc-2479e0a504d9 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7" returned: 0 in 0.849s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ac9e074b-e430-45e1-b5cc-2479e0a504d9 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.611s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:05 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ac9e074b-e430-45e1-b5cc-2479e0a504d9 tempest-VolumesDeleteCascade-969775107 None] Create snapshot completed successfully Jul 06 12:12:05 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0f1a6c26-f4d7-41b4-aacb-24899f66847e" returned: 0 in 0.897s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-80006433-2ecf-487c-8ead-f48c0ae0b702-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-0f1a6c26-f4d7-41b4-aacb-24899f66847e" released by "_delete_snapshot" :: held 5.392s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" released by "delete_snapshot" :: held 5.442s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-80006433-2ecf-487c-8ead-f48c0ae0b702-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Performing cascade delete. {{(pid=86761) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-87004828-b292-4643-b2fa-2e228803e6f7-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-87004828-b292-4643-b2fa-2e228803e6f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Created reservations ['a3dc17e8-04b4-43a4-9b1d-f9cbce9ae24d', '7ebcdec1-2f9e-4952-aad9-8eee6292fbe1', 'e4205ca0-efc5-4afd-bfbe-2fdce8a38c53', '75a01e08-72ac-4328-a12e-6b8d4751ad51'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-quobyte-80006433-2ecf-487c-8ead-f48c0ae0b702" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-80006433-2ecf-487c-8ead-f48c0ae0b702" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-quobyte-87004828-b292-4643-b2fa-2e228803e6f7" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-87004828-b292-4643-b2fa-2e228803e6f7" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Deleting offline snapshot 87004828-b292-4643-b2fa-2e228803e6f7 of volume 80006433-2ecf-487c-8ead-f48c0ae0b702 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] snapshot_file for this snap is: volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8f6d69-5e27-4e46-9e41-4fe2b949d3a0]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:05 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Delete snapshot completed successfully. Jul 06 12:12:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-25effeef-397c-44fb-a8ab-7843d35ba40a tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-0f1a6c26-f4d7-41b4-aacb-24899f66847e-delete_snapshot" released by "delete_snapshot" :: held 5.757s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:05 devstack sudo[92279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7 Jul 06 12:12:05 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:06 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7" returned: 0 in 0.894s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80006433-2ecf-487c-8ead-f48c0ae0b702(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:06 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6c4817-2ab9-4e78-a8a9-f2b105bbabb2]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:06 devstack sudo[92305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 Jul 06 12:12:06 devstack sudo[92305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2cd117c9-b574-4efe-8bfa-4dd729c26745 tempest-SnapshotsActionsTest-1039763116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2cd117c9-b574-4efe-8bfa-4dd729c26745 tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-2cd117c9-b574-4efe-8bfa-4dd729c26745 tempest-SnapshotsActionsTest-1039763116 None] Creating offline snapshot 0128daf6-1510-4d2d-b769-2e31934feff0 of volume 676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:12:07 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[701b5b74-dcb7-4e34-8c15-18f759fd12a6]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2cd117c9-b574-4efe-8bfa-4dd729c26745 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:07 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 Jul 06 12:12:07 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:07 devstack sudo[92305]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46" returned: 0 in 0.885s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80006433-2ecf-487c-8ead-f48c0ae0b702(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:07 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7 Jul 06 12:12:07 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:08 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2cd117c9-b574-4efe-8bfa-4dd729c26745 tempest-SnapshotsActionsTest-1039763116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" returned: 0 in 1.073s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-2cd117c9-b574-4efe-8bfa-4dd729c26745 tempest-SnapshotsActionsTest-1039763116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676f6733-c914-4076-a1ee-3f35adc0c7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2cd117c9-b574-4efe-8bfa-4dd729c26745 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:08 devstack sudo[92318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0 1G Jul 06 12:12:08 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:08 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7" returned: 0 in 0.821s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:08 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7 Jul 06 12:12:08 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:09 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2cd117c9-b574-4efe-8bfa-4dd729c26745 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0 1G" returned: 0 in 0.994s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2cd117c9-b574-4efe-8bfa-4dd729c26745 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:09 devstack sudo[92330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0 Jul 06 12:12:09 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:09 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.87004828-b292-4643-b2fa-2e228803e6f7" returned: 0 in 0.874s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-87004828-b292-4643-b2fa-2e228803e6f7" released by "_delete_snapshot" :: held 3.637s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-80006433-2ecf-487c-8ead-f48c0ae0b702" released by "delete_snapshot" :: held 3.676s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Created reservations ['39231c10-40cb-4bfc-94be-d7ca414081ff', '9ef94417-da13-40cd-82a2-8fc05ac20627', '9c495816-aeb0-4276-930c-da0e40c7612b', '18c7ca1f-e84f-4280-9b61-99cdc6934721'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:09 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Delete snapshot completed successfully. Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-87004828-b292-4643-b2fa-2e228803e6f7-delete_snapshot" released by "delete_snapshot" :: held 3.904s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-e28eabdc-1e10-46fc-b175-5a225b771e46-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-e28eabdc-1e10-46fc-b175-5a225b771e46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-quobyte-80006433-2ecf-487c-8ead-f48c0ae0b702" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-80006433-2ecf-487c-8ead-f48c0ae0b702" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-quobyte-e28eabdc-1e10-46fc-b175-5a225b771e46" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-e28eabdc-1e10-46fc-b175-5a225b771e46" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Deleting offline snapshot e28eabdc-1e10-46fc-b175-5a225b771e46 of volume 80006433-2ecf-487c-8ead-f48c0ae0b702 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] snapshot_file for this snap is: volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[28950778-c3ac-4e32-a606-2cbc323e94e4]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:09 devstack sudo[92333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 Jul 06 12:12:09 devstack sudo[92333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:09 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2cd117c9-b574-4efe-8bfa-4dd729c26745 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0" returned: 0 in 0.822s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:09 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-2cd117c9-b574-4efe-8bfa-4dd729c26745 tempest-SnapshotsActionsTest-1039763116 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0 is being set with open permissions: ugo+rw Jul 06 12:12:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2cd117c9-b574-4efe-8bfa-4dd729c26745 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:09 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0 Jul 06 12:12:09 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:10 devstack sudo[92333]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46" returned: 0 in 0.869s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80006433-2ecf-487c-8ead-f48c0ae0b702(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:10 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d29f221-fbae-4323-9311-0b12dca9621c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:10 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2cd117c9-b574-4efe-8bfa-4dd729c26745 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0" returned: 0 in 0.740s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:10 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702 Jul 06 12:12:10 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2cd117c9-b574-4efe-8bfa-4dd729c26745 tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.754s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:10 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2cd117c9-b574-4efe-8bfa-4dd729c26745 tempest-SnapshotsActionsTest-1039763116 None] Create snapshot completed successfully Jul 06 12:12:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Acquiring lock "cinder-0128daf6-1510-4d2d-b769-2e31934feff0-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:11 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-0128daf6-1510-4d2d-b769-2e31934feff0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Acquiring lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702" returned: 0 in 0.861s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Acquiring lock "cinder-quobyte-0128daf6-1510-4d2d-b769-2e31934feff0" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:11 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 Jul 06 12:12:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-0128daf6-1510-4d2d-b769-2e31934feff0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:11 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:11 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Deleting offline snapshot 0128daf6-1510-4d2d-b769-2e31934feff0 of volume 676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:12:11 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] snapshot_file for this snap is: volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:12:11 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9821858-1b54-471b-8e61-149dfb4efde8]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:11 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0 Jul 06 12:12:11 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:12 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46" returned: 0 in 0.863s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:12 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46 Jul 06 12:12:12 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:12 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0" returned: 0 in 0.941s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676f6733-c914-4076-a1ee-3f35adc0c7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:12 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c918856e-8627-4ad6-95ca-2a490e35e34e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:12 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 Jul 06 12:12:12 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:13 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702.e28eabdc-1e10-46fc-b175-5a225b771e46" returned: 0 in 0.746s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-e28eabdc-1e10-46fc-b175-5a225b771e46" released by "_delete_snapshot" :: held 3.448s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-80006433-2ecf-487c-8ead-f48c0ae0b702" released by "delete_snapshot" :: held 3.484s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:13 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Created reservations ['b34d8165-cd2f-4d4d-9127-df87786f14f0', '4fe489ca-a0ac-4552-af05-9bee5bbf1dc8', '136e8d46-007a-48aa-8148-314e8800f542', '5255c4fd-d01e-4229-aa1f-e91f5c9e8bdb'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:13 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Delete snapshot completed successfully. Jul 06 12:12:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-e28eabdc-1e10-46fc-b175-5a225b771e46-delete_snapshot" released by "delete_snapshot" :: held 3.691s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Snapshots deleted, issuing volume delete {{(pid=86761) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 12:12:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-quobyte-80006433-2ecf-487c-8ead-f48c0ae0b702" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-80006433-2ecf-487c-8ead-f48c0ae0b702" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:13 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b10ff8-1b2c-437c-a35d-f95d38d40f32]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:13 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" returned: 0 in 0.910s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676f6733-c914-4076-a1ee-3f35adc0c7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:13 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702 Jul 06 12:12:13 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:13 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0 Jul 06 12:12:13 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:14 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702" returned: 0 in 0.990s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:14 devstack sudo[92384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702 Jul 06 12:12:14 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:14 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0" returned: 0 in 1.163s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:14 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0 Jul 06 12:12:14 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:15 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-80006433-2ecf-487c-8ead-f48c0ae0b702" returned: 0 in 0.771s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-80006433-2ecf-487c-8ead-f48c0ae0b702" released by "delete_volume" :: held 1.845s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:15 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Created reservations ['3ba7b391-74fc-4347-a9b1-5a4c4a613764', 'ca8aba95-4c1c-40c6-a8c5-5bfa9ceb5b20', 'fca5e564-9af4-4d88-8958-26ab573db3c5', 'aaf60362-d848-4e16-872b-80fe42324219'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:15 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:15 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:12:15 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.0128daf6-1510-4d2d-b769-2e31934feff0" returned: 0 in 0.757s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-0128daf6-1510-4d2d-b769-2e31934feff0" released by "_delete_snapshot" :: held 3.906s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" released by "delete_snapshot" :: held 3.938s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:15 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Created reservations ['e495c62e-4a0f-4a3b-a2d9-ae21efe64db5', '301cf9b1-df6e-4e58-a60f-5cf218d351a6', '9b27a7c4-2792-4c61-8d74-d694982720bf', '29f9ee06-41ea-4973-99c0-54f007546678'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:15 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Delete snapshot completed successfully. Jul 06 12:12:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b59567b0-d022-404b-a238-23b967ce08d0 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-0128daf6-1510-4d2d-b769-2e31934feff0-delete_snapshot" released by "delete_snapshot" :: held 4.218s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-db1bd91a-c534-40b5-99c1-92bb4b83faa4 tempest-SnapshotsActionsTest-1039763116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-db1bd91a-c534-40b5-99c1-92bb4b83faa4 tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-db1bd91a-c534-40b5-99c1-92bb4b83faa4 tempest-SnapshotsActionsTest-1039763116 None] Creating offline snapshot 8b573275-0890-439a-9a6c-d23dcb8c6827 of volume 676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:12:16 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[4559d65e-3594-47f8-a905-150be323b1c6]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db1bd91a-c534-40b5-99c1-92bb4b83faa4 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:16 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.223s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:16 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:16 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Deleted volume successfully. Jul 06 12:12:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cafffb13-9504-41d2-9cb0-1b01e9254130 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-80006433-2ecf-487c-8ead-f48c0ae0b702-delete_volume" released by "delete_volume" :: held 11.050s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:16 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 Jul 06 12:12:16 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Flow 'volume_create_manager' (59fed248-e95e-4e19-b398-3aa393276e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b3d451-446b-4cfc-bc46-1a976c91c3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b3d451-446b-4cfc-bc46-1a976c91c3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1013327686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482c80c8-49ec-41ca-aca0-6037a5a32589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb894769e244d2885b2d01db040c42d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:17Z,use_quota=True,user_id='4bb93e55ec52417cb7966e7893540a59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d69249-148d-4208-bbc7-4cb0f447fc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d69249-148d-4208-bbc7-4cb0f447fc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2142ed79-41d4-48f4-a0b6-325972f5d269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2142ed79-41d4-48f4-a0b6-325972f5d269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482c80c8-49ec-41ca-aca0-6037a5a32589', 'volume_name': 'volume-482c80c8-49ec-41ca-aca0-6037a5a32589', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae58d5ec-ba3c-4210-af4b-990cf5145b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae58d5ec-ba3c-4210-af4b-990cf5145b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433cd6cf-b53f-4cd5-884a-e793ef9b957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:17 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Volume 482c80c8-49ec-41ca-aca0-6037a5a32589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482c80c8-49ec-41ca-aca0-6037a5a32589', 'volume_size': 1} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:17 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db1bd91a-c534-40b5-99c1-92bb4b83faa4 tempest-SnapshotsActionsTest-1039763116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" returned: 0 in 1.100s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-db1bd91a-c534-40b5-99c1-92bb4b83faa4 tempest-SnapshotsActionsTest-1039763116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676f6733-c914-4076-a1ee-3f35adc0c7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db1bd91a-c534-40b5-99c1-92bb4b83faa4 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:17 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827 1G Jul 06 12:12:17 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Flow 'volume_create_manager' (7bd49235-27bb-4e26-a365-e6106d018aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7048a3f4-ce84-45aa-81b8-326e44ce8813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7048a3f4-ce84-45aa-81b8-326e44ce8813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-64784901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f7e60f-a0e6-41c6-9e23-78dfae0a2e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e28233ad20d24f169a37a59f941fe686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:18Z,use_quota=True,user_id='fe8cd664886b4b21ba0063111fc4c49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8656d5-cc9f-40a4-8b77-cee2bbda3692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8656d5-cc9f-40a4-8b77-cee2bbda3692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb27c1c5-ec24-41ff-b069-9871bb87ca34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb27c1c5-ec24-41ff-b069-9871bb87ca34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83f7e60f-a0e6-41c6-9e23-78dfae0a2e73', 'volume_name': 'volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1b1ead-a9c8-40a1-9426-ce34342206ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1b1ead-a9c8-40a1-9426-ce34342206ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea03407-768f-4192-b61b-6edde107a0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:17 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Volume 83f7e60f-a0e6-41c6-9e23-78dfae0a2e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73', 'volume_size': 1} Jul 06 12:12:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:18 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db1bd91a-c534-40b5-99c1-92bb4b83faa4 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827 1G" returned: 0 in 0.890s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db1bd91a-c534-40b5-99c1-92bb4b83faa4 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:18 devstack sudo[92421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827 Jul 06 12:12:18 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:19 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db1bd91a-c534-40b5-99c1-92bb4b83faa4 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827" returned: 0 in 0.785s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:19 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-db1bd91a-c534-40b5-99c1-92bb4b83faa4 tempest-SnapshotsActionsTest-1039763116 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827 is being set with open permissions: ugo+rw Jul 06 12:12:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db1bd91a-c534-40b5-99c1-92bb4b83faa4 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:19 devstack sudo[92426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827 Jul 06 12:12:19 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:19 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db1bd91a-c534-40b5-99c1-92bb4b83faa4 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827" returned: 0 in 0.677s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-db1bd91a-c534-40b5-99c1-92bb4b83faa4 tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.616s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.853s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1013327686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482c80c8-49ec-41ca-aca0-6037a5a32589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb894769e244d2885b2d01db040c42d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:17Z,use_quota=True,user_id='4bb93e55ec52417cb7966e7893540a59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:12:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Creating volume 482c80c8-49ec-41ca-aca0-6037a5a32589 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:12:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:12:19 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:12:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:19 devstack sudo[92429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 1073741824 Jul 06 12:12:19 devstack sudo[92429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:19 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-db1bd91a-c534-40b5-99c1-92bb4b83faa4 tempest-SnapshotsActionsTest-1039763116 None] Create snapshot completed successfully Jul 06 12:12:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Acquiring lock "cinder-8b573275-0890-439a-9a6c-d23dcb8c6827-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-8b573275-0890-439a-9a6c-d23dcb8c6827-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Acquiring lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Acquiring lock "cinder-quobyte-8b573275-0890-439a-9a6c-d23dcb8c6827" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-8b573275-0890-439a-9a6c-d23dcb8c6827" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Deleting offline snapshot 8b573275-0890-439a-9a6c-d23dcb8c6827 of volume 676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:12:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] snapshot_file for this snap is: volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:12:20 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[497a784d-4be3-4ea4-9bd1-aa9285ad6505]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:20 devstack sudo[92429]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 1073741824" returned: 0 in 0.913s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:20 devstack sudo[92435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827 Jul 06 12:12:20 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:20 devstack sudo[92437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 Jul 06 12:12:20 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:21 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589" returned: 0 in 0.776s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.851s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-64784901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f7e60f-a0e6-41c6-9e23-78dfae0a2e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e28233ad20d24f169a37a59f941fe686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:18Z,use_quota=True,user_id='fe8cd664886b4b21ba0063111fc4c49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Creating volume 83f7e60f-a0e6-41c6-9e23-78dfae0a2e73 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:12:21 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:21 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827" returned: 0 in 0.982s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676f6733-c914-4076-a1ee-3f35adc0c7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:21 devstack sudo[92444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73 1073741824 Jul 06 12:12:21 devstack sudo[92444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433cd6cf-b53f-4cd5-884a-e793ef9b957f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482c80c8-49ec-41ca-aca0-6037a5a32589', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3b0faa-32c6-43c5-a4f2-17352d0e5d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[60659c87-60d8-4782-8bdc-3a6d791ee200]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:21 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Volume volume-482c80c8-49ec-41ca-aca0-6037a5a32589 (482c80c8-49ec-41ca-aca0-6037a5a32589): created successfully Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3b0faa-32c6-43c5-a4f2-17352d0e5d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Flow 'volume_create_manager' (59fed248-e95e-4e19-b398-3aa393276e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:21 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2c689495-6089-49cb-b730-43c5c8e94dc9 tempest-VolumesDeleteCascade-969775107 None] Created volume successfully. Jul 06 12:12:22 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 Jul 06 12:12:22 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:22 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" returned: 0 in 1.063s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676f6733-c914-4076-a1ee-3f35adc0c7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:22 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827 Jul 06 12:12:22 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:22 devstack sudo[92444]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73 1073741824" returned: 0 in 1.197s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:22 devstack sudo[92457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73 Jul 06 12:12:23 devstack sudo[92457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:23 devstack sudo[92457]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73" returned: 0 in 0.759s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:12:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.230s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] Creating offline snapshot ef064028-c425-49f6-b0b6-c8a2d697267d of volume 482c80c8-49ec-41ca-aca0-6037a5a32589 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:12:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea03407-768f-4192-b61b-6edde107a0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c238775-d0b5-4830-bec4-611c2f9c1d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:23 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbec639-ab72-4a05-9465-351f33264045]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:23 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:23 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Volume volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73 (83f7e60f-a0e6-41c6-9e23-78dfae0a2e73): created successfully Jul 06 12:12:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c238775-d0b5-4830-bec4-611c2f9c1d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Flow 'volume_create_manager' (7bd49235-27bb-4e26-a365-e6106d018aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827" returned: 0 in 0.970s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:23 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a70b4303-bfd5-4b1e-aa11-788facff948e tempest-AttachVolumeNegativeTest-1291209686 None] Created volume successfully. Jul 06 12:12:23 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827 Jul 06 12:12:23 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:23 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 Jul 06 12:12:23 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:24 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.8b573275-0890-439a-9a6c-d23dcb8c6827" returned: 0 in 0.831s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-8b573275-0890-439a-9a6c-d23dcb8c6827" released by "_delete_snapshot" :: held 3.987s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" released by "delete_snapshot" :: held 4.011s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:24 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Created reservations ['9f174646-2caf-4254-a02e-48354d861b7d', 'bd94b679-6971-4d92-bc30-142cc3324f81', '0e5a29a9-a285-4c40-b7db-e8e1c5f7f8b6', 'f82a5574-d34a-46f3-86cf-43f2bb0c8bcc'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:24 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589" returned: 0 in 1.022s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:24 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d 1G Jul 06 12:12:24 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:24 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Delete snapshot completed successfully. Jul 06 12:12:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9d40cb5c-5010-477b-b9aa-c9a8b95839f5 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-8b573275-0890-439a-9a6c-d23dcb8c6827-delete_snapshot" released by "delete_snapshot" :: held 4.224s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ca072914-8f7d-48f8-a9fd-f74c13901776 tempest-SnapshotsActionsTest-1039763116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:25 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d 1G" returned: 0 in 1.003s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-482c80c8-49ec-41ca-aca0-6037a5a32589 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:25 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-482c80c8-49ec-41ca-aca0-6037a5a32589 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d Jul 06 12:12:25 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:27 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-482c80c8-49ec-41ca-aca0-6037a5a32589 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d" returned: 0 in 1.164s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:27 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d is being set with open permissions: ugo+rw Jul 06 12:12:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:27 devstack sudo[92515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d Jul 06 12:12:27 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-55a13a89-0018-4bb7-b93a-98407235e8e0 req-143080dd-bf98-4934-8c85-25d369f043d7 tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:27 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d" returned: 0 in 0.776s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:27 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.info Jul 06 12:12:27 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:28 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.info" returned: 0 in 0.782s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:28 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.info is being set with open permissions: ugo+rw Jul 06 12:12:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:28 devstack sudo[92531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.info Jul 06 12:12:28 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:29 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.info" returned: 0 in 0.703s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.597s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ca072914-8f7d-48f8-a9fd-f74c13901776 tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.988s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ca072914-8f7d-48f8-a9fd-f74c13901776 tempest-SnapshotsActionsTest-1039763116 None] Creating offline snapshot 7a81a8a6-7849-40b5-8891-f732a9976cf5 of volume 676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:12:29 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a916921-1e6c-411d-a1a1-cc30df8ea624]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ca072914-8f7d-48f8-a9fd-f74c13901776 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:29 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f8f2a315-a017-4a03-9723-691ab0e2a6d6 tempest-VolumesDeleteCascade-969775107 None] Create snapshot completed successfully Jul 06 12:12:29 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 Jul 06 12:12:29 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:30 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ca072914-8f7d-48f8-a9fd-f74c13901776 tempest-SnapshotsActionsTest-1039763116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" returned: 0 in 0.943s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ca072914-8f7d-48f8-a9fd-f74c13901776 tempest-SnapshotsActionsTest-1039763116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676f6733-c914-4076-a1ee-3f35adc0c7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ca072914-8f7d-48f8-a9fd-f74c13901776 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:30 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5 1G Jul 06 12:12:30 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:30 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:12:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Flow 'volume_create_manager' (3bd80e44-8607-4b4f-b6c6-0d1270702b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c71c23-bf7b-41c3-b840-f9c43339b99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c71c23-bf7b-41c3-b840-f9c43339b99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-350107879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d78b081-81fa-4df3-9de6-997974ccbd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb894769e244d2885b2d01db040c42d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ef064028-c425-49f6-b0b6-c8a2d697267d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:30Z,use_quota=True,user_id='4bb93e55ec52417cb7966e7893540a59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d31fa94-2d04-4271-93ea-294f40dc5ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d31fa94-2d04-4271-93ea-294f40dc5ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdb13f3-05c0-430d-b514-bab3347ff409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdb13f3-05c0-430d-b514-bab3347ff409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d78b081-81fa-4df3-9de6-997974ccbd07', 'volume_name': 'volume-8d78b081-81fa-4df3-9de6-997974ccbd07', 'volume_size': 1, 'snapshot_id': 'ef064028-c425-49f6-b0b6-c8a2d697267d'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06c77eb-533d-45b9-8a07-26a63becca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06c77eb-533d-45b9-8a07-26a63becca9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9972a481-3c1c-4677-8274-75d934372999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:30 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Volume 8d78b081-81fa-4df3-9de6-997974ccbd07: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d78b081-81fa-4df3-9de6-997974ccbd07', 'volume_size': 1, 'snapshot_id': 'ef064028-c425-49f6-b0b6-c8a2d697267d'} Jul 06 12:12:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:31 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ca072914-8f7d-48f8-a9fd-f74c13901776 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5 1G" returned: 0 in 0.924s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ca072914-8f7d-48f8-a9fd-f74c13901776 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:31 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5 Jul 06 12:12:31 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:32 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ca072914-8f7d-48f8-a9fd-f74c13901776 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5" returned: 0 in 0.802s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:32 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-ca072914-8f7d-48f8-a9fd-f74c13901776 tempest-SnapshotsActionsTest-1039763116 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5 is being set with open permissions: ugo+rw Jul 06 12:12:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ca072914-8f7d-48f8-a9fd-f74c13901776 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:32 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5 Jul 06 12:12:32 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:32 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ca072914-8f7d-48f8-a9fd-f74c13901776 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5" returned: 0 in 0.691s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ca072914-8f7d-48f8-a9fd-f74c13901776 tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.474s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-55a13a89-0018-4bb7-b93a-98407235e8e0 req-143080dd-bf98-4934-8c85-25d369f043d7 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.384s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:32 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a831141-8636-4692-a07f-5ac8a9344b58]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-55a13a89-0018-4bb7-b93a-98407235e8e0 req-143080dd-bf98-4934-8c85-25d369f043d7 tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:32 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ca072914-8f7d-48f8-a9fd-f74c13901776 tempest-SnapshotsActionsTest-1039763116 None] Create snapshot completed successfully Jul 06 12:12:32 devstack sudo[92598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73 Jul 06 12:12:32 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:33 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-55a13a89-0018-4bb7-b93a-98407235e8e0 req-143080dd-bf98-4934-8c85-25d369f043d7 tempest-AttachVolumeNegativeTest-1291209686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73" returned: 0 in 0.885s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-55a13a89-0018-4bb7-b93a-98407235e8e0 req-143080dd-bf98-4934-8c85-25d369f043d7 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.916s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.153s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-quobyte-ef064028-c425-49f6-b0b6-c8a2d697267d-8d78b081-81fa-4df3-9de6-997974ccbd07" by "_create_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-ef064028-c425-49f6-b0b6-c8a2d697267d-8d78b081-81fa-4df3-9de6-997974ccbd07" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Creating volume 8d78b081-81fa-4df3-9de6-997974ccbd07 from snapshot ef064028-c425-49f6-b0b6-c8a2d697267d {{(pid=86761) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-quobyte-8d78b081-81fa-4df3-9de6-997974ccbd07" by "_copy_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-8d78b081-81fa-4df3-9de6-997974ccbd07" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] snapshot: ef064028-c425-49f6-b0b6-c8a2d697267d, volume: 8d78b081-81fa-4df3-9de6-997974ccbd07, {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-55a13a89-0018-4bb7-b93a-98407235e8e0 req-143080dd-bf98-4934-8c85-25d369f043d7 tempest-AttachVolumeNegativeTest-1291209686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0833ac6-639c-42dc-a28d-8375ab315ee1', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Acquiring lock "cinder-7a81a8a6-7849-40b5-8891-f732a9976cf5-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed45202e-dbbe-4d9b-8958-e0c4ed675930]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-7a81a8a6-7849-40b5-8891-f732a9976cf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Acquiring lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Acquiring lock "cinder-quobyte-7a81a8a6-7849-40b5-8891-f732a9976cf5" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-7a81a8a6-7849-40b5-8891-f732a9976cf5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Deleting offline snapshot 7a81a8a6-7849-40b5-8891-f732a9976cf5 of volume 676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] snapshot_file for this snap is: volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:12:34 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-55a13a89-0018-4bb7-b93a-98407235e8e0 req-143080dd-bf98-4934-8c85-25d369f043d7 tempest-AttachVolumeNegativeTest-1291209686 None] attachment_update completed successfully. Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd7a7e3-f0b4-469c-8c38-8ae31ed012e5]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:34 devstack sudo[92604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d Jul 06 12:12:34 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:34 devstack sudo[92605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5 Jul 06 12:12:34 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Acquiring lock "cinder-7e115ddc-c941-4391-9f78-834bb78dc099-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Lock "cinder-7e115ddc-c941-4391-9f78-834bb78dc099-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Acquiring lock "cinder-quobyte-7e115ddc-c941-4391-9f78-834bb78dc099" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Lock "cinder-quobyte-7e115ddc-c941-4391-9f78-834bb78dc099" acquired by "delete_volume" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc51731-13c2-4614-bc46-980b6cf3a694]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7e115ddc-c941-4391-9f78-834bb78dc099 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:34 devstack sudo[92608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7e115ddc-c941-4391-9f78-834bb78dc099 Jul 06 12:12:34 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:34 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d" returned: 0 in 1.021s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-482c80c8-49ec-41ca-aca0-6037a5a32589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Creating direct copy from snapshot {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[b727b839-90b6-4fde-9d37-cd8da403751b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:35 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5" returned: 0 in 0.978s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676f6733-c914-4076-a1ee-3f35adc0c7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:35 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 Jul 06 12:12:35 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[098e2715-ebbe-4ce8-8239-1d473296a0df]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:35 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:35 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 Jul 06 12:12:35 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:35 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7e115ddc-c941-4391-9f78-834bb78dc099" returned: 0 in 0.959s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7e115ddc-c941-4391-9f78-834bb78dc099 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:35 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7e115ddc-c941-4391-9f78-834bb78dc099 Jul 06 12:12:35 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:35 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589" returned: 0 in 0.929s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:35 devstack cinder-volume[86761]: DEBUG cinder.utils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Path /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8d78b081-81fa-4df3-9de6-997974ccbd07 not found in is_blk_device check {{(pid=86761) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:12:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8d78b081-81fa-4df3-9de6-997974ccbd07 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:35 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8d78b081-81fa-4df3-9de6-997974ccbd07 Jul 06 12:12:35 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:35 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" returned: 0 in 0.891s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676f6733-c914-4076-a1ee-3f35adc0c7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:35 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5 Jul 06 12:12:35 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:36 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7e115ddc-c941-4391-9f78-834bb78dc099" returned: 0 in 0.834s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Lock "cinder-quobyte-7e115ddc-c941-4391-9f78-834bb78dc099" released by "delete_volume" :: held 1.859s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:36 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Created reservations ['03853d11-32cb-48f3-9c4d-816c2bcae33f', 'fe7c4e10-9b6b-4325-8ef4-bcf7a995e749', 'd9160fc4-9d12-48a1-bc44-48e672f5c028', '85cc6b21-f9fb-403c-9fdb-b8fc74c205b0'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:36 devstack sudo[93019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:12:36 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:37 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5" returned: 0 in 1.266s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:37 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5 Jul 06 12:12:37 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:37 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.165s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:37 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:37 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Deleted volume successfully. Jul 06 12:12:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-155610f9-acd8-4525-9a1a-a31aefb56e65 tempest-AttachVolumeShelveTestJSON-406136481 None] Lock "cinder-7e115ddc-c941-4391-9f78-834bb78dc099-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:39 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.7a81a8a6-7849-40b5-8891-f732a9976cf5" returned: 0 in 2.100s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-7a81a8a6-7849-40b5-8891-f732a9976cf5" released by "_delete_snapshot" :: held 5.447s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" released by "delete_snapshot" :: held 5.500s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:39 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=79,cinder:UPDATE=65,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:12:39 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Created reservations ['ee8531a6-1eaa-476f-9707-3c0f990bd8cd', '4108f253-1927-446f-8b95-f1def2165fdd', '664ff54a-ad75-4ed3-8abf-7e6e78e3bec2', '56f23031-9ee2-4846-a145-2cc4fb2592b1'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:39 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Delete snapshot completed successfully. Jul 06 12:12:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-07667570-71c9-43f0-a2f0-a0220f7792a2 tempest-SnapshotsActionsTest-1328185229 None] Lock "cinder-7a81a8a6-7849-40b5-8891-f732a9976cf5-delete_snapshot" released by "delete_snapshot" :: held 5.954s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Acquiring lock "cinder-cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Lock "cinder-cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Acquiring lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Acquiring lock "cinder-quobyte-cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Lock "cinder-quobyte-cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Deleting offline snapshot cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 of volume 676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:12:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] snapshot_file for this snap is: volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:12:42 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2524101-72d0-4d64-838a-e1404657b20d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:42 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 Jul 06 12:12:42 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:42 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8d78b081-81fa-4df3-9de6-997974ccbd07" returned: 0 in 6.839s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:42 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0c0d64-1a49-4957-8e78-58b8e2e2628e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:42 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 Jul 06 12:12:42 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:43 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" returned: 0 in 1.383s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676f6733-c914-4076-a1ee-3f35adc0c7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:43 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[97214ec4-5085-4667-9538-b35f34e2b213]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:43 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb Jul 06 12:12:43 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:43 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589" returned: 0 in 1.225s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:43 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589, size 1024.00 MB, duration 6.84 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8d78b081-81fa-4df3-9de6-997974ccbd07 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:12:43 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Converted 1024.00 MB image at 149.70 MB/s Jul 06 12:12:43 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8d78b081-81fa-4df3-9de6-997974ccbd07 is being set with open permissions: ugo+rw Jul 06 12:12:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8d78b081-81fa-4df3-9de6-997974ccbd07 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:43 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8d78b081-81fa-4df3-9de6-997974ccbd07 Jul 06 12:12:43 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:44 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb" returned: 0 in 1.255s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:44 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8d78b081-81fa-4df3-9de6-997974ccbd07" returned: 0 in 1.006s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-8d78b081-81fa-4df3-9de6-997974ccbd07" released by "_copy_volume_from_snapshot" :: held 11.177s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:44 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 Jul 06 12:12:44 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-ef064028-c425-49f6-b0b6-c8a2d697267d-8d78b081-81fa-4df3-9de6-997974ccbd07" released by "_create_volume_from_snapshot" :: held 11.235s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.259s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9972a481-3c1c-4677-8274-75d934372999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d78b081-81fa-4df3-9de6-997974ccbd07', 'volume_size': 1, 'snapshot_id': 'ef064028-c425-49f6-b0b6-c8a2d697267d'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c91fe1-e491-4eb1-a569-16b52ae3ccec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:45 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Volume volume-8d78b081-81fa-4df3-9de6-997974ccbd07 (8d78b081-81fa-4df3-9de6-997974ccbd07): created successfully Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c91fe1-e491-4eb1-a569-16b52ae3ccec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Flow 'volume_create_manager' (3bd80e44-8607-4b4f-b6c6-0d1270702b98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:45 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2b5bdee6-a5b9-4f10-970f-bb7d8e4da457 tempest-VolumesDeleteCascade-969775107 None] Created volume successfully. Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-482c80c8-49ec-41ca-aca0-6037a5a32589-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-482c80c8-49ec-41ca-aca0-6037a5a32589-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Performing cascade delete. {{(pid=86761) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-ef064028-c425-49f6-b0b6-c8a2d697267d-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-ef064028-c425-49f6-b0b6-c8a2d697267d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-quobyte-482c80c8-49ec-41ca-aca0-6037a5a32589" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-482c80c8-49ec-41ca-aca0-6037a5a32589" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-quobyte-ef064028-c425-49f6-b0b6-c8a2d697267d" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-ef064028-c425-49f6-b0b6-c8a2d697267d" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Deleting offline snapshot ef064028-c425-49f6-b0b6-c8a2d697267d of volume 482c80c8-49ec-41ca-aca0-6037a5a32589 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] snapshot_file for this snap is: volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[471d13c1-dbfa-4a3c-ace0-87d67872dfd7]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:45 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d Jul 06 12:12:45 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:46 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" returned: 0 in 1.235s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:46 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679 Jul 06 12:12:46 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:46 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d" returned: 0 in 1.077s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-482c80c8-49ec-41ca-aca0-6037a5a32589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:46 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c2d625-64f9-4825-adf0-d98ab5292f50]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:47 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 Jul 06 12:12:47 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:47 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb.cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" returned: 0 in 0.919s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Lock "cinder-quobyte-cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679" released by "_delete_snapshot" :: held 5.069s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" released by "delete_snapshot" :: held 5.130s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:47 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Created reservations ['78d1e228-b6b5-45f2-9c1d-9479281f4111', '37b6bc8e-a031-40f4-9c85-246adb7d95b5', 'c4977bdc-db28-4209-aa8b-d8d8a2d51f13', '342440c9-0c70-4777-9466-778ae338cc7d'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:47 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Delete snapshot completed successfully. Jul 06 12:12:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-71895548-6233-44e2-89a4-7c43a2032bc8 tempest-SnapshotsActionsTest-1039763116 None] Lock "cinder-cb4ee1f2-b1c7-4fa3-a3d0-edcf670e1679-delete_snapshot" released by "delete_snapshot" :: held 5.385s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:47 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589" returned: 0 in 0.983s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:47 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d Jul 06 12:12:47 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Acquiring lock "cinder-676f6733-c914-4076-a1ee-3f35adc0c7bb-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Lock "cinder-676f6733-c914-4076-a1ee-3f35adc0c7bb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Acquiring lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" acquired by "delete_volume" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:48 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58d4cff-1d51-467b-98ee-c8969cb93722]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:48 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d" returned: 0 in 0.859s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:48 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d Jul 06 12:12:48 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:48 devstack sudo[93100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb Jul 06 12:12:48 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:49 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589.ef064028-c425-49f6-b0b6-c8a2d697267d" returned: 0 in 0.844s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-ef064028-c425-49f6-b0b6-c8a2d697267d" released by "_delete_snapshot" :: held 3.920s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-482c80c8-49ec-41ca-aca0-6037a5a32589" released by "delete_snapshot" :: held 3.977s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:49 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb" returned: 0 in 1.036s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:49 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb Jul 06 12:12:49 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:49 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Created reservations ['63c5971b-051b-43d9-826e-9931894ec47e', 'ae8f08ae-56bb-468c-9979-8c401ac7a981', '547444b0-019f-4f5f-811f-e2b5760f21b6', '8c572c78-68d5-4d78-ba78-e5ea456eb331'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:49 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Delete snapshot completed successfully. Jul 06 12:12:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-ef064028-c425-49f6-b0b6-c8a2d697267d-delete_snapshot" released by "delete_snapshot" :: held 4.186s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Snapshots deleted, issuing volume delete {{(pid=86761) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 12:12:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-quobyte-482c80c8-49ec-41ca-aca0-6037a5a32589" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-482c80c8-49ec-41ca-aca0-6037a5a32589" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:49 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[21893ed2-71df-4348-9761-79b3e498a5e0]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:50 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 Jul 06 12:12:50 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:50 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-676f6733-c914-4076-a1ee-3f35adc0c7bb" returned: 0 in 0.832s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Lock "cinder-quobyte-676f6733-c914-4076-a1ee-3f35adc0c7bb" released by "delete_volume" :: held 1.949s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:50 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Created reservations ['4e951464-364d-4cf5-91a1-b8c7f359861d', '3845ddff-f762-4fe8-8381-8f25e1ea4ac5', '01d2332a-17bb-4686-aae0-0002f28b35f2', '676cfe89-2248-4b68-a48f-80e7d52fe589'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:50 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:12:50 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:51 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589" returned: 0 in 1.401s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:51 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589 Jul 06 12:12:51 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:51 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.013s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:51 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Deleted volume successfully. Jul 06 12:12:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8caf6c9-0183-4b13-a285-17b9fc87258e tempest-SnapshotsActionsTest-1039763116 None] Lock "cinder-676f6733-c914-4076-a1ee-3f35adc0c7bb-delete_volume" released by "delete_volume" :: held 3.245s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:52 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-482c80c8-49ec-41ca-aca0-6037a5a32589" returned: 0 in 1.101s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-482c80c8-49ec-41ca-aca0-6037a5a32589" released by "delete_volume" :: held 2.598s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=83,cinder:DELETE=8,cinder:INSERT=21,cinder:UPDATE=88 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Created reservations ['834deb0d-c8a8-4cf5-ac73-c4dd263ff141', 'f1944919-7ae9-4779-8390-e56d76169d28', 'bf51a8ea-4c64-40d6-a836-4ce1d7c00bfc', '9efd6849-cdf2-4e6a-8620-3bc3784289b8'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:52 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:12:52 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:52 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:12:52 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-8d78b081-81fa-4df3-9de6-997974ccbd07-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-8d78b081-81fa-4df3-9de6-997974ccbd07-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:53 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.267s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:12:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:12:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:12:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "cinder-quobyte-8d78b081-81fa-4df3-9de6-997974ccbd07" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-8d78b081-81fa-4df3-9de6-997974ccbd07" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:53 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.275s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:53 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Deleted volume successfully. Jul 06 12:12:53 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c44dc8e-9be9-40e3-9128-52285d8df6da]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8d78b081-81fa-4df3-9de6-997974ccbd07 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2bd3d605-6a48-43c9-a48e-09a45bce366f tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-482c80c8-49ec-41ca-aca0-6037a5a32589-delete_volume" released by "delete_volume" :: held 8.463s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:54 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8d78b081-81fa-4df3-9de6-997974ccbd07 Jul 06 12:12:54 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:54 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8d78b081-81fa-4df3-9de6-997974ccbd07" returned: 0 in 1.064s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8d78b081-81fa-4df3-9de6-997974ccbd07 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:55 devstack sudo[93176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8d78b081-81fa-4df3-9de6-997974ccbd07 Jul 06 12:12:55 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:55 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8d78b081-81fa-4df3-9de6-997974ccbd07" returned: 0 in 0.811s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-quobyte-8d78b081-81fa-4df3-9de6-997974ccbd07" released by "delete_volume" :: held 1.940s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:55 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Created reservations ['bc9f39b8-ce07-4d8b-8d48-43cdf4568d66', '511e65f5-770b-45f0-a3f5-2bc7c2225a41', '56f83a20-34f6-40aa-9838-3a5ed1e8e1e7', 'e526dbd8-3aa0-445e-b74d-6cc2c4b1be0c'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:56 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:12:56 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:57 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.146s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:57 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:57 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Deleted volume successfully. Jul 06 12:12:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6db9c7b-772d-4dd1-8eeb-42a5744971a1 tempest-VolumesDeleteCascade-969775107 None] Lock "cinder-8d78b081-81fa-4df3-9de6-997974ccbd07-delete_volume" released by "delete_volume" :: held 3.452s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Flow 'volume_create_manager' (5fbe3933-d900-4daa-b622-7ccc4a9e4f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b15a76-7968-4be0-a201-2bf927083088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b15a76-7968-4be0-a201-2bf927083088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-694798189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20501e2-58ae-4fb6-8f2f-0caf87f359d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786bae1495f241249b06f06d3f763753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:02Z,use_quota=True,user_id='33b9b685d4af43e4ac4fe4261d42db06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d19feb-b900-4fda-8bb8-a39255a545f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d19feb-b900-4fda-8bb8-a39255a545f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41077e0a-e501-4749-9bdd-bee9a623831f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41077e0a-e501-4749-9bdd-bee9a623831f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd20501e2-58ae-4fb6-8f2f-0caf87f359d9', 'volume_name': 'volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ea1428-5a43-45fd-86f3-f9084118dfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ea1428-5a43-45fd-86f3-f9084118dfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c654636-61e0-45ab-a41b-4fcd91c08a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:02 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Volume d20501e2-58ae-4fb6-8f2f-0caf87f359d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9', 'volume_size': 1} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-694798189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20501e2-58ae-4fb6-8f2f-0caf87f359d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786bae1495f241249b06f06d3f763753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:02Z,use_quota=True,user_id='33b9b685d4af43e4ac4fe4261d42db06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Creating volume d20501e2-58ae-4fb6-8f2f-0caf87f359d9 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:02 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:13:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:02 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9 1073741824 Jul 06 12:13:02 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:03 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9 1073741824" returned: 0 in 1.416s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:03 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9 Jul 06 12:13:03 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:04 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9" returned: 0 in 0.963s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] <== create_volume: return (2443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.445s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c654636-61e0-45ab-a41b-4fcd91c08a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d34191f-0c3e-4010-8391-e81fcd9032a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:04 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Volume volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9 (d20501e2-58ae-4fb6-8f2f-0caf87f359d9): created successfully Jul 06 12:13:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d34191f-0c3e-4010-8391-e81fcd9032a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Flow 'volume_create_manager' (5fbe3933-d900-4daa-b622-7ccc4a9e4f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:04 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-e11d4141-9ca9-41b1-a0dc-9e76355a1120 tempest-VolumesMetadataTest-1207839746 None] Created volume successfully. Jul 06 12:13:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Acquiring lock "cinder-d20501e2-58ae-4fb6-8f2f-0caf87f359d9-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Lock "cinder-d20501e2-58ae-4fb6-8f2f-0caf87f359d9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Acquiring lock "cinder-quobyte-d20501e2-58ae-4fb6-8f2f-0caf87f359d9" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Lock "cinder-quobyte-d20501e2-58ae-4fb6-8f2f-0caf87f359d9" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:06 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3c6e9d-0deb-472d-af8d-548793d89ecc]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:06 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9 Jul 06 12:13:06 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:07 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9" returned: 0 in 0.864s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:07 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9 Jul 06 12:13:07 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:07 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d20501e2-58ae-4fb6-8f2f-0caf87f359d9" returned: 0 in 0.739s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Lock "cinder-quobyte-d20501e2-58ae-4fb6-8f2f-0caf87f359d9" released by "delete_volume" :: held 1.654s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:07 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Created reservations ['1a70d105-2ad2-47a7-8a75-cfe719d034c9', '2c561bb9-bec6-4fdc-9e25-a1e105382f38', '783f136a-5e06-4155-86eb-3b49814cd661', 'f3d85087-05cc-423e-8abc-491aacf74edb'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:08 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:13:08 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:09 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.584s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:09 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:13:09 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Deleted volume successfully. Jul 06 12:13:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-093eb34d-aa9e-4725-b8aa-9d2c51cbb1d8 tempest-VolumesMetadataTest-1207839746 None] Lock "cinder-d20501e2-58ae-4fb6-8f2f-0caf87f359d9-delete_volume" released by "delete_volume" :: held 3.585s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:INSERT=5,cinder:UPDATE=38,cinder:SELECT=13,cinder:DELETE=2 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Flow 'volume_create_manager' (87ce6467-fabd-467a-84ee-3673d234b1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54309d35-fb8d-4af2-b501-97d483b19841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54309d35-fb8d-4af2-b501-97d483b19841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-810293299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2c71fa-7684-41c2-ac21-ac020e12c649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4831bfcbb9e5402e99e3aced81094aaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:18Z,use_quota=True,user_id='5575cad7ab28447a8346d21cc52a2226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e36fb83-6f19-49c6-85f1-4ba4c08b1717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e36fb83-6f19-49c6-85f1-4ba4c08b1717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec7254b-969d-4d54-baa2-1593aaa9c446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec7254b-969d-4d54-baa2-1593aaa9c446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af2c71fa-7684-41c2-ac21-ac020e12c649', 'volume_name': 'volume-af2c71fa-7684-41c2-ac21-ac020e12c649', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4b7bd4-49bb-4b2c-a178-2e17323924e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4b7bd4-49bb-4b2c-a178-2e17323924e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ccbaf0-c1f4-44dd-9a69-22a279b462ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:18 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Volume af2c71fa-7684-41c2-ac21-ac020e12c649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af2c71fa-7684-41c2-ac21-ac020e12c649', 'volume_size': 1} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-810293299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2c71fa-7684-41c2-ac21-ac020e12c649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4831bfcbb9e5402e99e3aced81094aaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:18Z,use_quota=True,user_id='5575cad7ab28447a8346d21cc52a2226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Creating volume af2c71fa-7684-41c2-ac21-ac020e12c649 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:18 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:13:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af2c71fa-7684-41c2-ac21-ac020e12c649 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:18 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af2c71fa-7684-41c2-ac21-ac020e12c649 1073741824 Jul 06 12:13:18 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:19 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af2c71fa-7684-41c2-ac21-ac020e12c649 1073741824" returned: 0 in 1.039s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af2c71fa-7684-41c2-ac21-ac020e12c649 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:19 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af2c71fa-7684-41c2-ac21-ac020e12c649 Jul 06 12:13:19 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:19 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Flow 'volume_create_manager' (a8247c72-6d45-4a94-9608-5892a7f8532f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298bc87e-c07c-4b9d-aad4-19f8883d45ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298bc87e-c07c-4b9d-aad4-19f8883d45ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1012957797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e46eb5889f34fb7ac230d768770a89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:20Z,use_quota=True,user_id='4dd14d7561a2472ca72f0a3db8a56488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3084592b-4255-40db-af24-4330f458b3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3084592b-4255-40db-af24-4330f458b3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4b1e6e-62b6-44e6-9e96-9d94e79bca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4b1e6e-62b6-44e6-9e96-9d94e79bca00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0', 'volume_name': 'volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e49fb5-cd44-4879-a2f5-7ce8bcd060c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e49fb5-cd44-4879-a2f5-7ce8bcd060c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fea863f-efcb-4f25-a99e-3344e6c8592a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:19 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Volume 2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0', 'volume_size': 1} Jul 06 12:13:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:20 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af2c71fa-7684-41c2-ac21-ac020e12c649" returned: 0 in 0.787s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.323s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1012957797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e46eb5889f34fb7ac230d768770a89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:20Z,use_quota=True,user_id='4dd14d7561a2472ca72f0a3db8a56488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Creating volume 2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:20 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:20 devstack sudo[93288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0 1073741824 Jul 06 12:13:20 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ccbaf0-c1f4-44dd-9a69-22a279b462ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af2c71fa-7684-41c2-ac21-ac020e12c649', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b96b2d-e2b9-43d2-9ba7-09e8b90c81f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:20 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Volume volume-af2c71fa-7684-41c2-ac21-ac020e12c649 (af2c71fa-7684-41c2-ac21-ac020e12c649): created successfully Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b96b2d-e2b9-43d2-9ba7-09e8b90c81f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Flow 'volume_create_manager' (87ce6467-fabd-467a-84ee-3673d234b1a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:20 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a3c20042-7e3d-4a94-808a-0ea30f066f38 tempest-VolumesTransfersV355Test-1722905093 None] Created volume successfully. Jul 06 12:13:20 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0 1073741824" returned: 0 in 0.909s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:21 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0 Jul 06 12:13:21 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:22 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0" returned: 0 in 1.138s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fea863f-efcb-4f25-a99e-3344e6c8592a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671fed39-bedb-46bf-a068-3e253b6056b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:22 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Volume volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0 (2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0): created successfully Jul 06 12:13:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671fed39-bedb-46bf-a068-3e253b6056b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Flow 'volume_create_manager' (a8247c72-6d45-4a94-9608-5892a7f8532f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:22 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c799b622-b7ad-49fa-b928-cacc08dc63e7 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Created volume successfully. Jul 06 12:13:22 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0d05cbac-1afb-4539-a1a2-d79ad0d5cc9a tempest-VolumesTransfersV355Test-943576411 None] Transfer volume completed successfully. Jul 06 12:13:23 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Acquiring lock "cinder-af2c71fa-7684-41c2-ac21-ac020e12c649-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:23 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Lock "cinder-af2c71fa-7684-41c2-ac21-ac020e12c649-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:23 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Acquiring lock "cinder-quobyte-af2c71fa-7684-41c2-ac21-ac020e12c649" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:23 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Lock "cinder-quobyte-af2c71fa-7684-41c2-ac21-ac020e12c649" acquired by "delete_volume" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:23 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ec531a-5583-4493-a9f2-413f488112c8]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af2c71fa-7684-41c2-ac21-ac020e12c649 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:24 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af2c71fa-7684-41c2-ac21-ac020e12c649 Jul 06 12:13:24 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Acquiring lock "cinder-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Lock "cinder-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Acquiring lock "cinder-quobyte-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Lock "cinder-quobyte-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:24 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf0fb2b-f382-4965-9ad2-dab44cfc0c0f]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:24 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0 Jul 06 12:13:24 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:25 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af2c71fa-7684-41c2-ac21-ac020e12c649" returned: 0 in 1.502s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af2c71fa-7684-41c2-ac21-ac020e12c649 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:25 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af2c71fa-7684-41c2-ac21-ac020e12c649 Jul 06 12:13:25 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:25 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0" returned: 0 in 1.358s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:25 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0 Jul 06 12:13:25 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:26 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-af2c71fa-7684-41c2-ac21-ac020e12c649" returned: 0 in 1.033s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:26 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Lock "cinder-quobyte-af2c71fa-7684-41c2-ac21-ac020e12c649" released by "delete_volume" :: held 2.614s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:26 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Created reservations ['664c02c2-257c-46ae-a428-85b64fbdf95b', 'a1205b4b-cf43-424f-a6aa-da3d9e0c9f0e', '977440de-dd51-49c5-9f2e-f16cbfd3df57', '77966b7f-ee46-4235-b81a-474b169b67a9'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:26 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:13:26 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:26 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0" returned: 0 in 1.070s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Lock "cinder-quobyte-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0" released by "delete_volume" :: held 2.502s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:27 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Created reservations ['f222c9c0-04fc-47c9-afd5-637c64f1c433', '9fd6c7fa-ba56-4fea-9325-4c0d49730c12', 'b5a460f6-483c-4e6a-bde1-781440afc6ea', 'b3077b70-4132-4203-96ab-e6fb2839cbb0'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:27 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:13:27 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:27 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.154s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:27 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:13:27 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Deleted volume successfully. Jul 06 12:13:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58bf9126-0b8a-41d0-bf2a-5818f4d68e13 tempest-VolumesTransfersV355Test-419818103 None] Lock "cinder-af2c71fa-7684-41c2-ac21-ac020e12c649-delete_volume" released by "delete_volume" :: held 4.148s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Flow 'volume_create_manager' (b615952c-f1d3-42d3-a2f5-0a38b9ae9493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a31c804-3ce8-4fd5-a444-57909679f706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a31c804-3ce8-4fd5-a444-57909679f706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-888367879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b83b873-ef2a-46a3-bb37-4a73a10e2067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4831bfcbb9e5402e99e3aced81094aaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:28Z,use_quota=True,user_id='5575cad7ab28447a8346d21cc52a2226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b8002b-90e2-4b5a-8133-caef68e14430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b8002b-90e2-4b5a-8133-caef68e14430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56884df-5f49-450e-9128-566e6d6e42cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56884df-5f49-450e-9128-566e6d6e42cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b83b873-ef2a-46a3-bb37-4a73a10e2067', 'volume_name': 'volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130afb87-29e4-4d78-80f9-dca648ee9688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130afb87-29e4-4d78-80f9-dca648ee9688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7812a33-c860-4a66-8d90-d18b5be1db02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:28 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Volume 2b83b873-ef2a-46a3-bb37-4a73a10e2067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067', 'volume_size': 1} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-888367879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b83b873-ef2a-46a3-bb37-4a73a10e2067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4831bfcbb9e5402e99e3aced81094aaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:28Z,use_quota=True,user_id='5575cad7ab28447a8346d21cc52a2226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Creating volume 2b83b873-ef2a-46a3-bb37-4a73a10e2067 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:28 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:28 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067 1073741824 Jul 06 12:13:28 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:28 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.350s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:13:28 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Deleted volume successfully. Jul 06 12:13:28 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c644f5af-9036-45fd-911a-5812b8a96fd5 tempest-VolumeQuotasNegativeTestJSON-815097478 None] Lock "cinder-2f0b4e8a-ef0f-4d47-b35d-d7a754b243b0-delete_volume" released by "delete_volume" :: held 4.238s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:29 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067 1073741824" returned: 0 in 1.153s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:29 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067 Jul 06 12:13:29 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:30 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067" returned: 0 in 1.094s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] <== create_volume: return (2309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.312s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7812a33-c860-4a66-8d90-d18b5be1db02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8e9a5a-9b22-43ba-8e2f-acb0d9eed8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:30 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Volume volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067 (2b83b873-ef2a-46a3-bb37-4a73a10e2067): created successfully Jul 06 12:13:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8e9a5a-9b22-43ba-8e2f-acb0d9eed8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Flow 'volume_create_manager' (b615952c-f1d3-42d3-a2f5-0a38b9ae9493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:30 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ab047a84-f54c-46f1-802a-e0929e7a10f6 tempest-VolumesTransfersV355Test-1722905093 None] Created volume successfully. Jul 06 12:13:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Acquiring lock "cinder-2b83b873-ef2a-46a3-bb37-4a73a10e2067-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Lock "cinder-2b83b873-ef2a-46a3-bb37-4a73a10e2067-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Acquiring lock "cinder-quobyte-2b83b873-ef2a-46a3-bb37-4a73a10e2067" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Lock "cinder-quobyte-2b83b873-ef2a-46a3-bb37-4a73a10e2067" acquired by "delete_volume" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:32 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd059748-26dc-4477-b9c6-6f874b953ed3]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:32 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067 Jul 06 12:13:32 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:33 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067" returned: 0 in 1.232s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:33 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067 Jul 06 12:13:33 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:34 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2b83b873-ef2a-46a3-bb37-4a73a10e2067" returned: 0 in 0.880s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Lock "cinder-quobyte-2b83b873-ef2a-46a3-bb37-4a73a10e2067" released by "delete_volume" :: held 2.184s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:34 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Created reservations ['5802443c-0357-467a-84d7-0259a97bc6e8', 'c5caf319-7e4d-4797-ab81-8966a1cba961', 'dc65df37-da46-44ca-b5e3-e954198ee805', '606279d2-ffdb-4894-9b31-335a7b368d19'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:34 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:34 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:34 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:13:34 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:35 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.785s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:35 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:13:35 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Deleted volume successfully. Jul 06 12:13:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c2e263de-8d37-4d40-a7aa-8cde4e437ddc tempest-VolumesTransfersV355Test-419818103 None] Lock "cinder-2b83b873-ef2a-46a3-bb37-4a73a10e2067-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Flow 'volume_create_manager' (4996902c-b71e-4504-ba37-c72bff870fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49675c51-ab95-4476-af82-7b140416861a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49675c51-ab95-4476-af82-7b140416861a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-160978316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd1ff7e-8ee9-43a9-9295-f12913495c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec40ef48e1fd4996bab453af06d5137c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:37Z,use_quota=True,user_id='42028145e1484f688de679546d8a074d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29ca23bc-99d3-4b8f-8b95-82c7965f8af2),volume_type_id=29ca23bc-99d3-4b8f-8b95-82c7965f8af2)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868bcc3a-2c63-4b4d-b23b-eb2d87a1dbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868bcc3a-2c63-4b4d-b23b-eb2d87a1dbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7092672-06d2-4962-bdca-e937598a65ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7092672-06d2-4962-bdca-e937598a65ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fd1ff7e-8ee9-43a9-9295-f12913495c3c', 'volume_name': 'volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7b1f4b-6217-407a-839c-4560591114b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7b1f4b-6217-407a-839c-4560591114b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f071ae-bc88-42b0-976e-61efd1d72dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:37 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Volume 6fd1ff7e-8ee9-43a9-9295-f12913495c3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c', 'volume_size': 1} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-160978316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd1ff7e-8ee9-43a9-9295-f12913495c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec40ef48e1fd4996bab453af06d5137c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:37Z,use_quota=True,user_id='42028145e1484f688de679546d8a074d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29ca23bc-99d3-4b8f-8b95-82c7965f8af2),volume_type_id=29ca23bc-99d3-4b8f-8b95-82c7965f8af2)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Creating volume 6fd1ff7e-8ee9-43a9-9295-f12913495c3c {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:37 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:13:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:37 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c 1073741824 Jul 06 12:13:37 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:38 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c 1073741824" returned: 0 in 1.385s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:39 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c Jul 06 12:13:39 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:39 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c" returned: 0 in 0.709s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] <== create_volume: return (2179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.183s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:39 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=70,cinder:INSERT=28,cinder:UPDATE=73,cinder:DELETE=4 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:13:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f071ae-bc88-42b0-976e-61efd1d72dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f24957-74d8-4cdc-a388-c3a8dcf486ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:39 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Volume volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c (6fd1ff7e-8ee9-43a9-9295-f12913495c3c): created successfully Jul 06 12:13:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f24957-74d8-4cdc-a388-c3a8dcf486ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Flow 'volume_create_manager' (4996902c-b71e-4504-ba37-c72bff870fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:39 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-9d08f07d-3b82-48f5-9f92-7c60ecffbd71 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Created volume successfully. Jul 06 12:13:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-26ee252f-98e6-4ea8-ab0f-c23074fe2572 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-26ee252f-98e6-4ea8-ab0f-c23074fe2572 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-26ee252f-98e6-4ea8-ab0f-c23074fe2572 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-26ee252f-98e6-4ea8-ab0f-c23074fe2572 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-26ee252f-98e6-4ea8-ab0f-c23074fe2572 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-26ee252f-98e6-4ea8-ab0f-c23074fe2572 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:41 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:13:41 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:42 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-26ee252f-98e6-4ea8-ab0f-c23074fe2572 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.752s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:42 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-26ee252f-98e6-4ea8-ab0f-c23074fe2572 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:13:42 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-26ee252f-98e6-4ea8-ab0f-c23074fe2572 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Retype volume completed successfully. Jul 06 12:13:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Acquiring lock "cinder-6fd1ff7e-8ee9-43a9-9295-f12913495c3c-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Lock "cinder-6fd1ff7e-8ee9-43a9-9295-f12913495c3c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Acquiring lock "cinder-quobyte-6fd1ff7e-8ee9-43a9-9295-f12913495c3c" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Lock "cinder-quobyte-6fd1ff7e-8ee9-43a9-9295-f12913495c3c" acquired by "delete_volume" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:42 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a54863-c360-4b92-8fd8-98387a93126a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:42 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c Jul 06 12:13:42 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:43 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c" returned: 0 in 0.963s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:43 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c Jul 06 12:13:43 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:44 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6fd1ff7e-8ee9-43a9-9295-f12913495c3c" returned: 0 in 0.834s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Lock "cinder-quobyte-6fd1ff7e-8ee9-43a9-9295-f12913495c3c" released by "delete_volume" :: held 1.869s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:44 devstack cinder-volume[86761]: WARNING cinder.quota [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:13:44 devstack cinder-volume[86761]: WARNING cinder.quota [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:13:44 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Created reservations ['49691705-13a3-405b-a5a0-f6e80365e8c6', '6c06dc47-7686-4d02-bb7f-560f7ed5cb28', '4aadaf3e-10b4-443e-be01-91b74ec963ac', '095795fa-cfed-4fcc-99bf-ecd640e0698e'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:44 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:44 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:44 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:13:44 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:45 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-451e3fe6-7ce9-443e-96dd-f341bcf565b9 req-e626a2ad-2c48-4cfb-a62b-171e391fdd37 tempest-AttachVolumeNegativeTest-1291209686 None] Terminate volume connection completed successfully. Jul 06 12:13:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-451e3fe6-7ce9-443e-96dd-f341bcf565b9 req-e626a2ad-2c48-4cfb-a62b-171e391fdd37 tempest-AttachVolumeNegativeTest-1291209686 None] Deleting attachment d0833ac6-639c-42dc-a28d-8375ab315ee1. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:13:45 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.168s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:45 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:13:45 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Deleted volume successfully. Jul 06 12:13:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-388b2f3c-61ca-4a94-94ee-1829b0848f92 tempest-VolumeRetypeWithoutMigrationTest-1497209606 None] Lock "cinder-6fd1ff7e-8ee9-43a9-9295-f12913495c3c-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Flow 'volume_create_manager' (7541363d-81a2-4555-a034-7358f3b5d828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65218bf5-872e-437d-ab8c-c2d18868ec35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65218bf5-872e-437d-ab8c-c2d18868ec35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1114467125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d023a32-cd83-4686-acbb-dc471708d793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f5e65222cc48148b8928e58ae0c0c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:49Z,use_quota=True,user_id='53b93f2057aa491c8e37175b3573e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef93aea0-9dbf-45ca-8527-135fda0ed98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef93aea0-9dbf-45ca-8527-135fda0ed98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c647a476-0b08-470e-98b7-5c316ef872a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c647a476-0b08-470e-98b7-5c316ef872a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d023a32-cd83-4686-acbb-dc471708d793', 'volume_name': 'volume-1d023a32-cd83-4686-acbb-dc471708d793', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4f9381-e025-4066-b960-28f9346f909c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4f9381-e025-4066-b960-28f9346f909c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c34b3e-365d-409b-80e7-6d06f5671f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:49 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Volume 1d023a32-cd83-4686-acbb-dc471708d793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d023a32-cd83-4686-acbb-dc471708d793', 'volume_size': 1} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1114467125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d023a32-cd83-4686-acbb-dc471708d793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f5e65222cc48148b8928e58ae0c0c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:49Z,use_quota=True,user_id='53b93f2057aa491c8e37175b3573e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Creating volume 1d023a32-cd83-4686-acbb-dc471708d793 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:49 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:13:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1d023a32-cd83-4686-acbb-dc471708d793 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:49 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1d023a32-cd83-4686-acbb-dc471708d793 1073741824 Jul 06 12:13:49 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:50 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1d023a32-cd83-4686-acbb-dc471708d793 1073741824" returned: 0 in 1.543s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1d023a32-cd83-4686-acbb-dc471708d793 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:50 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1d023a32-cd83-4686-acbb-dc471708d793 Jul 06 12:13:50 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:51 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1d023a32-cd83-4686-acbb-dc471708d793" returned: 0 in 0.884s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:51 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] <== create_volume: return (2514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.521s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c34b3e-365d-409b-80e7-6d06f5671f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d023a32-cd83-4686-acbb-dc471708d793', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e68bc4-24f8-4c9a-ba76-ae553983c38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:51 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Volume volume-1d023a32-cd83-4686-acbb-dc471708d793 (1d023a32-cd83-4686-acbb-dc471708d793): created successfully Jul 06 12:13:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e68bc4-24f8-4c9a-ba76-ae553983c38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Flow 'volume_create_manager' (7541363d-81a2-4555-a034-7358f3b5d828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-79d04c25-422d-49d2-82ad-567692513b92 tempest-AttachVolumeTestJSON-2137043288 None] Created volume successfully. Jul 06 12:13:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:13:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:52 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:13:52 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:53 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.993s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:13:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:13:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:13:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:13:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-7093d90b-f55a-4533-b8ec-f08512bb2234 req-7c9f96d7-2990-42cc-9d58-c4a379471b8e tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-7093d90b-f55a-4533-b8ec-f08512bb2234 req-7c9f96d7-2990-42cc-9d58-c4a379471b8e tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:55 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c281975-c513-42a6-b23e-93a90eca82d8]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-7093d90b-f55a-4533-b8ec-f08512bb2234 req-7c9f96d7-2990-42cc-9d58-c4a379471b8e tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1d023a32-cd83-4686-acbb-dc471708d793 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:55 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1d023a32-cd83-4686-acbb-dc471708d793 Jul 06 12:13:55 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:56 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Flow 'volume_create_manager' (cea04530-e143-4abb-9473-38750e038c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2997b8e-0c21-4238-bee3-5959c36245a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2997b8e-0c21-4238-bee3-5959c36245a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1328469197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d136be1eca6a493c9e71ae4d2179cd06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:57Z,use_quota=True,user_id='e083caeac0da4eaeb9e0401953968491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887b6ec9-0dca-4f62-bcf4-b34daf5df8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887b6ec9-0dca-4f62-bcf4-b34daf5df8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a53fd4-f6b4-4bf6-8d04-70b8c7a30012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a53fd4-f6b4-4bf6-8d04-70b8c7a30012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee', 'volume_name': 'volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730bfee8-2f89-4f04-ad4c-eef4c619d786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730bfee8-2f89-4f04-ad4c-eef4c619d786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815c8419-efd8-4d60-be8c-0f2733e2ea44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:56 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Volume 2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee', 'volume_size': 1} Jul 06 12:13:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:57 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-7093d90b-f55a-4533-b8ec-f08512bb2234 req-7c9f96d7-2990-42cc-9d58-c4a379471b8e tempest-AttachVolumeTestJSON-2137043288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1d023a32-cd83-4686-acbb-dc471708d793" returned: 0 in 1.247s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-7093d90b-f55a-4533-b8ec-f08512bb2234 req-7c9f96d7-2990-42cc-9d58-c4a379471b8e tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.278s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.119s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1328469197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d136be1eca6a493c9e71ae4d2179cd06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:57Z,use_quota=True,user_id='e083caeac0da4eaeb9e0401953968491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Creating volume 2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:57 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:13:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:57 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee 1073741824 Jul 06 12:13:57 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-7093d90b-f55a-4533-b8ec-f08512bb2234 req-7c9f96d7-2990-42cc-9d58-c4a379471b8e tempest-AttachVolumeTestJSON-2137043288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-1d023a32-cd83-4686-acbb-dc471708d793', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '412bdcac-76d8-476d-81e5-80159a4168f0', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:13:57 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-7093d90b-f55a-4533-b8ec-f08512bb2234 req-7c9f96d7-2990-42cc-9d58-c4a379471b8e tempest-AttachVolumeTestJSON-2137043288 None] attachment_update completed successfully. Jul 06 12:13:58 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee 1073741824" returned: 0 in 1.199s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:58 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee Jul 06 12:13:58 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:59 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" returned: 0 in 0.985s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] <== create_volume: return (2247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.253s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815c8419-efd8-4d60-be8c-0f2733e2ea44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b766483-a116-4ae8-a8a2-54b16590e3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:59 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Volume volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee (2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee): created successfully Jul 06 12:13:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b766483-a116-4ae8-a8a2-54b16590e3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Flow 'volume_create_manager' (cea04530-e143-4abb-9473-38750e038c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:59 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ac7aad30-c4e0-49cd-8745-d6f74970bd3f tempest-VolumesActionsTest-1559946920 None] Created volume successfully. Jul 06 12:14:05 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Flow 'volume_create_manager' (1a96068b-ef1a-4650-928e-9015e3744540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318d9593-7817-4e5b-a965-8867f1bde6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318d9593-7817-4e5b-a965-8867f1bde6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-705035617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da87b0d-6b33-4363-b660-768c26d15f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155d144d39e04a319db7f049373721dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:06Z,use_quota=True,user_id='47cbb31c0e114bc682c88ed92e8d0f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f76080-3506-4bc5-8ede-aebcc85cd4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f76080-3506-4bc5-8ede-aebcc85cd4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381d2c52-817b-4287-b305-5ad5fafa5d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381d2c52-817b-4287-b305-5ad5fafa5d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4da87b0d-6b33-4363-b660-768c26d15f20', 'volume_name': 'volume-4da87b0d-6b33-4363-b660-768c26d15f20', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9529040-1f63-4acf-8056-5d5352a3dcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9529040-1f63-4acf-8056-5d5352a3dcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e054cea9-a4c4-4e89-a7da-6ae04bc1f9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:06 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Volume 4da87b0d-6b33-4363-b660-768c26d15f20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4da87b0d-6b33-4363-b660-768c26d15f20', 'volume_size': 1} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-705035617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da87b0d-6b33-4363-b660-768c26d15f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155d144d39e04a319db7f049373721dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:06Z,use_quota=True,user_id='47cbb31c0e114bc682c88ed92e8d0f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Creating volume 4da87b0d-6b33-4363-b660-768c26d15f20 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:06 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:14:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4da87b0d-6b33-4363-b660-768c26d15f20 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:06 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4da87b0d-6b33-4363-b660-768c26d15f20 1073741824 Jul 06 12:14:06 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:07 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4da87b0d-6b33-4363-b660-768c26d15f20 1073741824" returned: 0 in 0.977s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4da87b0d-6b33-4363-b660-768c26d15f20 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:07 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4da87b0d-6b33-4363-b660-768c26d15f20 Jul 06 12:14:07 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:08 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4da87b0d-6b33-4363-b660-768c26d15f20" returned: 0 in 0.928s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:14:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e054cea9-a4c4-4e89-a7da-6ae04bc1f9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da87b0d-6b33-4363-b660-768c26d15f20', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbb33ad-544d-4abd-b115-8188ff1b126a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:08 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Volume volume-4da87b0d-6b33-4363-b660-768c26d15f20 (4da87b0d-6b33-4363-b660-768c26d15f20): created successfully Jul 06 12:14:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbb33ad-544d-4abd-b115-8188ff1b126a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Flow 'volume_create_manager' (1a96068b-ef1a-4650-928e-9015e3744540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:08 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2c10a300-16f3-4c37-bf37-b30e1842d698 tempest-VolumesTransfersV357Test-1229141257 None] Created volume successfully. Jul 06 12:14:10 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4716bec8-7b6b-4db9-ad14-4bae0f0d8528 tempest-VolumesTransfersV357Test-1074651895 None] Transfer volume completed successfully. Jul 06 12:14:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Acquiring lock "cinder-4da87b0d-6b33-4363-b660-768c26d15f20-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Lock "cinder-4da87b0d-6b33-4363-b660-768c26d15f20-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Acquiring lock "cinder-quobyte-4da87b0d-6b33-4363-b660-768c26d15f20" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Lock "cinder-quobyte-4da87b0d-6b33-4363-b660-768c26d15f20" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:11 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b685f3-8863-4fca-8ceb-a1ea8889d9f3]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4da87b0d-6b33-4363-b660-768c26d15f20 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:11 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4da87b0d-6b33-4363-b660-768c26d15f20 Jul 06 12:14:11 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:12 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4da87b0d-6b33-4363-b660-768c26d15f20" returned: 0 in 1.258s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4da87b0d-6b33-4363-b660-768c26d15f20 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:12 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4da87b0d-6b33-4363-b660-768c26d15f20 Jul 06 12:14:12 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:13 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4da87b0d-6b33-4363-b660-768c26d15f20" returned: 0 in 0.830s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Lock "cinder-quobyte-4da87b0d-6b33-4363-b660-768c26d15f20" released by "delete_volume" :: held 2.156s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:13 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Created reservations ['8c47307a-61ed-4e4a-96a7-376932c5a48d', 'c413b827-49cc-41b9-8f4a-fc9a18b8d262', 'c7ab1796-9dce-4fa6-a5a2-0b170eda4291', '048f8404-0805-4083-a703-829073c28ec9'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:13 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:14:13 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:14 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.977s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:14 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:14 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Deleted volume successfully. Jul 06 12:14:14 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6bfbd5d5-4e3c-460e-9675-b3e53374a43b tempest-VolumesTransfersV357Test-1413160125 None] Lock "cinder-4da87b0d-6b33-4363-b660-768c26d15f20-delete_volume" released by "delete_volume" :: held 3.423s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Flow 'volume_create_manager' (ee59faef-906b-47e5-a6d3-3de0eb1082a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29861b5c-047b-49bd-a8d6-4054b471d446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29861b5c-047b-49bd-a8d6-4054b471d446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1851312163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5baea22-d40b-44d3-9b58-9e9b97d4f932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155d144d39e04a319db7f049373721dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:16Z,use_quota=True,user_id='47cbb31c0e114bc682c88ed92e8d0f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b244c549-1a24-45de-a31c-7761212de093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b244c549-1a24-45de-a31c-7761212de093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b8507b-3d6e-49a5-afee-973564a01846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b8507b-3d6e-49a5-afee-973564a01846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5baea22-d40b-44d3-9b58-9e9b97d4f932', 'volume_name': 'volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cf47e8-9c3e-4ba6-88a1-fea899c4a22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cf47e8-9c3e-4ba6-88a1-fea899c4a22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61066151-1d62-4a24-9e7e-ba048717d48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:15 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Volume a5baea22-d40b-44d3-9b58-9e9b97d4f932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932', 'volume_size': 1} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1851312163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5baea22-d40b-44d3-9b58-9e9b97d4f932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155d144d39e04a319db7f049373721dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:16Z,use_quota=True,user_id='47cbb31c0e114bc682c88ed92e8d0f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Creating volume a5baea22-d40b-44d3-9b58-9e9b97d4f932 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:15 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:14:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:15 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932 1073741824 Jul 06 12:14:15 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:17 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932 1073741824" returned: 0 in 2.083s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:18 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932 Jul 06 12:14:18 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:19 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932" returned: 0 in 1.620s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] <== create_volume: return (3810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:14:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.816s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:19 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=49,cinder:INSERT=13,cinder:UPDATE=72,cinder:DELETE=8 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:14:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61066151-1d62-4a24-9e7e-ba048717d48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8bc513-b57f-4394-86c1-669a35aacd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:19 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Volume volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932 (a5baea22-d40b-44d3-9b58-9e9b97d4f932): created successfully Jul 06 12:14:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8bc513-b57f-4394-86c1-669a35aacd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Flow 'volume_create_manager' (ee59faef-906b-47e5-a6d3-3de0eb1082a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:19 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-3dbd46cd-3966-413d-94ed-4ef7c848176f tempest-VolumesTransfersV357Test-1229141257 None] Created volume successfully. Jul 06 12:14:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dec61f59-459b-4fdc-9d05-24741f5431cd tempest-VolumesActionsTest-1559946920 None] Acquiring lock "cinder-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" by "attach_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dec61f59-459b-4fdc-9d05-24741f5431cd tempest-VolumesActionsTest-1559946920 None] Lock "cinder-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" acquired by "attach_volume" :: waited 0.042s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:20 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-dec61f59-459b-4fdc-9d05-24741f5431cd tempest-VolumesActionsTest-1559946920 None] Attaching volume 2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee to instance 95691346-80f7-49d4-88ef-64cb6d389765 at mountpoint /dev/vdb on host None. Jul 06 12:14:20 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-dec61f59-459b-4fdc-9d05-24741f5431cd tempest-VolumesActionsTest-1559946920 None] Attach volume completed successfully. Jul 06 12:14:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dec61f59-459b-4fdc-9d05-24741f5431cd tempest-VolumesActionsTest-1559946920 None] Lock "cinder-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" released by "attach_volume" :: held 0.276s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7bf865ae-90ed-4a76-a81d-da2050992b74 tempest-VolumesActionsTest-1559946920 None] Acquiring lock "cinder-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee-detach_volume" by "detach_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7bf865ae-90ed-4a76-a81d-da2050992b74 tempest-VolumesActionsTest-1559946920 None] Lock "cinder-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee-detach_volume" acquired by "detach_volume" :: waited 0.069s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:21 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7bf865ae-90ed-4a76-a81d-da2050992b74 tempest-VolumesActionsTest-1559946920 None] Detaching volume 2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee from instance 95691346-80f7-49d4-88ef-64cb6d389765. Jul 06 12:14:21 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7bf865ae-90ed-4a76-a81d-da2050992b74 tempest-VolumesActionsTest-1559946920 None] Detach volume completed successfully. Jul 06 12:14:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7bf865ae-90ed-4a76-a81d-da2050992b74 tempest-VolumesActionsTest-1559946920 None] Lock "cinder-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee-detach_volume" released by "detach_volume" :: held 0.237s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Acquiring lock "cinder-a5baea22-d40b-44d3-9b58-9e9b97d4f932-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Lock "cinder-a5baea22-d40b-44d3-9b58-9e9b97d4f932-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Acquiring lock "cinder-quobyte-a5baea22-d40b-44d3-9b58-9e9b97d4f932" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Lock "cinder-quobyte-a5baea22-d40b-44d3-9b58-9e9b97d4f932" acquired by "delete_volume" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:21 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3ca3ba-a5f6-4374-8545-c0941e9acb6f]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:21 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932 Jul 06 12:14:21 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:23 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932" returned: 0 in 1.785s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:23 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932 Jul 06 12:14:23 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:24 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a5baea22-d40b-44d3-9b58-9e9b97d4f932" returned: 0 in 1.510s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Lock "cinder-quobyte-a5baea22-d40b-44d3-9b58-9e9b97d4f932" released by "delete_volume" :: held 3.409s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:25 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Created reservations ['de3342ee-bdc9-4b5e-a24c-3b609b22db31', '4620a6e3-14f4-4e55-9600-0a252893e9ed', '28884f83-c52b-418f-8d38-a9aefc57b894', '351387f6-ee03-4729-88dd-cb6db10b3c39'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:25 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:14:25 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:27 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.768s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:27 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:27 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Deleted volume successfully. Jul 06 12:14:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f197e4e1-1947-49d0-95bc-6bba20550703 tempest-VolumesTransfersV357Test-1413160125 None] Lock "cinder-a5baea22-d40b-44d3-9b58-9e9b97d4f932-delete_volume" released by "delete_volume" :: held 5.777s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:35 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:INSERT=5,cinder:SELECT=11,cinder:UPDATE=11 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:14:35 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Flow 'volume_create_manager' (afde7d59-dba2-4845-9eb9-763c34b2d7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15de63a0-8950-4fa3-a608-29e0bb4e9846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15de63a0-8950-4fa3-a608-29e0bb4e9846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-110880639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1812d7730148dbaf092b55fdb727b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:36Z,use_quota=True,user_id='79a1bd9f56794cfbb9b4c3e570aa8d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d2769f-4553-4290-9e8f-894d19ece8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d2769f-4553-4290-9e8f-894d19ece8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30465e60-8fb5-42b1-8a85-801bb71972af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:36 devstack cinder-volume[86761]: DEBUG cinder.image.glance [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Creating Keystone auth plugin from conf {{(pid=86761) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:14:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30465e60-8fb5-42b1-8a85-801bb71972af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7', 'volume_name': 'volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7', 'volume_size': 1, 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ecb593f86ab340bf8964e10d312ba960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676e6a03-e822-47bb-ae37-fb8632dfdee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676e6a03-e822-47bb-ae37-fb8632dfdee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76191a12-1fde-456b-8817-4fa33d7c31a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:36 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Volume 5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7', 'volume_size': 1, 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ecb593f86ab340bf8964e10d312ba960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 12:14:36 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Trying to clone 5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 from image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]). {{(pid=86761) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:14:36 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_z87c8hvddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:14:36 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Image download 20.69 MB at 20.69 MB/s Jul 06 12:14:36 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[e086cd50-9b14-4465-bf57-f2e8e6558446]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_z87c8hvddevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:37 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_z87c8hvddevstack@QuobyteHD Jul 06 12:14:37 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:37 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_z87c8hvddevstack@QuobyteHD" returned: 0 in 0.792s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:37 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Temporary image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 is fetched for user 79a1bd9f56794cfbb9b4c3e570aa8d6f. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:14:37 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7971d067-8489-4622-b270-b1d3a4873efc]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_z87c8hvddevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:37 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_z87c8hvddevstack@QuobyteHD Jul 06 12:14:37 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:38 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_z87c8hvddevstack@QuobyteHD" returned: 0 in 0.863s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-110880639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1812d7730148dbaf092b55fdb727b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:36Z,use_quota=True,user_id='79a1bd9f56794cfbb9b4c3e570aa8d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Creating volume 5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:38 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:14:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:38 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 1073741824 Jul 06 12:14:38 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:39 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 1073741824" returned: 0 in 1.083s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:39 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=47,cinder:UPDATE=50,cinder:INSERT=6,cinder:DELETE=5 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:14:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:39 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 Jul 06 12:14:39 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:40 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7" returned: 0 in 0.914s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:14:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:40 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Attempting download of 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}])) to volume 5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:14:40 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb68824-9af4-4d47-a9a6-815e746721ea]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_306a_jub {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:41 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_306a_jub Jul 06 12:14:41 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:41 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_306a_jub" returned: 0 in 0.859s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_306a_jub {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:41 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_306a_jub Jul 06 12:14:41 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:42 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_306a_jub" returned: 1 in 0.917s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_306a_jub' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:14:42 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fce83b-52b9-4037-93e3-c3d6d5939721]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_z87c8hvddevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:42 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_z87c8hvddevstack@QuobyteHD Jul 06 12:14:42 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:43 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_z87c8hvddevstack@QuobyteHD" returned: 0 in 0.871s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:43 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 was qcow2, converting to raw {{(pid=86761) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:14:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_z87c8hvddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:43 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_z87c8hvddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 Jul 06 12:14:43 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:46 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_z87c8hvddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7" returned: 0 in 2.830s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_z87c8hvddevstack@QuobyteHD, size 112.00 MB, duration 2.83 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:14:46 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Converted 112.00 MB image at 39.56 MB/s Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:46 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 1G Jul 06 12:14:46 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Flow 'volume_create_manager' (493b19c4-2477-4586-9bf3-3dc10bd2db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc9a5e3-a3a9-42de-b50e-966d5cd5ff99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc9a5e3-a3a9-42de-b50e-966d5cd5ff99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2083996669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb1613f-efe5-4a22-a043-b5a802e5d495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e28233ad20d24f169a37a59f941fe686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:47Z,use_quota=True,user_id='fe8cd664886b4b21ba0063111fc4c49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1604d0aa-e292-4a85-831b-683e8d0680f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1604d0aa-e292-4a85-831b-683e8d0680f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c19031d-5205-4f07-922b-0e1e584deb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c19031d-5205-4f07-922b-0e1e584deb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eb1613f-efe5-4a22-a043-b5a802e5d495', 'volume_name': 'volume-7eb1613f-efe5-4a22-a043-b5a802e5d495', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e4424d-5376-4d78-a746-b369c0ea99e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e4424d-5376-4d78-a746-b369c0ea99e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d608f6e1-f498-43d3-b04e-227d000bac52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:46 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Volume 7eb1613f-efe5-4a22-a043-b5a802e5d495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eb1613f-efe5-4a22-a043-b5a802e5d495', 'volume_size': 1} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2083996669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb1613f-efe5-4a22-a043-b5a802e5d495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e28233ad20d24f169a37a59f941fe686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:47Z,use_quota=True,user_id='fe8cd664886b4b21ba0063111fc4c49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Creating volume 7eb1613f-efe5-4a22-a043-b5a802e5d495 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:46 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:14:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7eb1613f-efe5-4a22-a043-b5a802e5d495 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:46 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7eb1613f-efe5-4a22-a043-b5a802e5d495 1073741824 Jul 06 12:14:46 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:47 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 1G" returned: 0 in 1.006s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:47 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58936a9-c978-4293-aba7-7b53829ed059]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:47 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 Jul 06 12:14:47 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:47 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7eb1613f-efe5-4a22-a043-b5a802e5d495 1073741824" returned: 0 in 1.081s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7eb1613f-efe5-4a22-a043-b5a802e5d495 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:48 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7eb1613f-efe5-4a22-a043-b5a802e5d495 Jul 06 12:14:48 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:48 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7" returned: 0 in 0.886s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:48 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 Jul 06 12:14:48 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:48 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7eb1613f-efe5-4a22-a043-b5a802e5d495" returned: 0 in 0.766s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:14:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d608f6e1-f498-43d3-b04e-227d000bac52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb1613f-efe5-4a22-a043-b5a802e5d495', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794dc53a-98b1-4ee6-93a2-088c4bce544f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:48 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Volume volume-7eb1613f-efe5-4a22-a043-b5a802e5d495 (7eb1613f-efe5-4a22-a043-b5a802e5d495): created successfully Jul 06 12:14:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794dc53a-98b1-4ee6-93a2-088c4bce544f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Flow 'volume_create_manager' (493b19c4-2477-4586-9bf3-3dc10bd2db62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:48 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-67ec95f7-cbe6-4778-88b2-911dd3846868 tempest-AttachVolumeNegativeTest-1291209686 None] Created volume successfully. Jul 06 12:14:49 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7" returned: 1 in 0.928s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:14:49 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Downloaded image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}])) to volume 5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 successfully. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:14:49 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Temporary image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 for user 79a1bd9f56794cfbb9b4c3e570aa8d6f is deleted. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:14:49 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Marking volume 5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 as bootable. {{(pid=86761) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:14:49 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Copying metadata from image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 to 5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7. {{(pid=86761) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:14:49 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Creating volume glance metadata for volume 5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 backed by image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86761) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:14:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76191a12-1fde-456b-8817-4fa33d7c31a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7', 'volume_size': 1, 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ecb593f86ab340bf8964e10d312ba960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626fa27c-718c-4fe2-b73b-4a79a49f843e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:49 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Volume volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 (5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7): created successfully Jul 06 12:14:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626fa27c-718c-4fe2-b73b-4a79a49f843e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Flow 'volume_create_manager' (afde7d59-dba2-4845-9eb9-763c34b2d7b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:49 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-49f2dc89-0af7-46ec-9e55-12423dab0d5f tempest-VolumesExtendTest-548849589 None] Created volume successfully. Jul 06 12:14:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0c5c1005-5a96-4d0b-854d-c505559b71a5 tempest-VolumesExtendTest-548849589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0c5c1005-5a96-4d0b-854d-c505559b71a5 tempest-VolumesExtendTest-548849589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:50 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[5423cd00-1095-46c3-b09a-7b335dcb4705]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0c5c1005-5a96-4d0b-854d-c505559b71a5 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:50 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 Jul 06 12:14:50 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b21880da-b383-4974-95eb-97df0e6f9700 tempest-VolumesActionsTest-1559946920 None] Acquiring lock "cinder-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" by "attach_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b21880da-b383-4974-95eb-97df0e6f9700 tempest-VolumesActionsTest-1559946920 None] Lock "cinder-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" acquired by "attach_volume" :: waited 0.035s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:50 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b21880da-b383-4974-95eb-97df0e6f9700 tempest-VolumesActionsTest-1559946920 None] Attaching volume 2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee to instance 3f9ef8a2-6efd-4941-aee6-c661c1f49955 at mountpoint /dev/vdb on host None. Jul 06 12:14:50 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b21880da-b383-4974-95eb-97df0e6f9700 tempest-VolumesActionsTest-1559946920 None] Attach volume completed successfully. Jul 06 12:14:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b21880da-b383-4974-95eb-97df0e6f9700 tempest-VolumesActionsTest-1559946920 None] Lock "cinder-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" released by "attach_volume" :: held 0.171s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6a593611-b8cc-4000-9ad7-87e75588892c tempest-VolumesActionsTest-1559946920 None] Acquiring lock "cinder-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee-detach_volume" by "detach_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:51 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0c5c1005-5a96-4d0b-854d-c505559b71a5 tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7" returned: 0 in 1.057s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0c5c1005-5a96-4d0b-854d-c505559b71a5 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6a593611-b8cc-4000-9ad7-87e75588892c tempest-VolumesActionsTest-1559946920 None] Lock "cinder-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6a593611-b8cc-4000-9ad7-87e75588892c tempest-VolumesActionsTest-1559946920 None] Detaching volume 2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee from instance 3f9ef8a2-6efd-4941-aee6-c661c1f49955. Jul 06 12:14:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6a593611-b8cc-4000-9ad7-87e75588892c tempest-VolumesActionsTest-1559946920 None] Detach volume completed successfully. Jul 06 12:14:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6a593611-b8cc-4000-9ad7-87e75588892c tempest-VolumesActionsTest-1559946920 None] Lock "cinder-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:51 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 Jul 06 12:14:51 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:52 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0c5c1005-5a96-4d0b-854d-c505559b71a5 tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7" returned: 1 in 1.020s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0c5c1005-5a96-4d0b-854d-c505559b71a5 tempest-VolumesExtendTest-548849589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:14:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0c5c1005-5a96-4d0b-854d-c505559b71a5 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 2G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:14:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:52 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:14:52 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0c5c1005-5a96-4d0b-854d-c505559b71a5 tempest-VolumesExtendTest-548849589 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 2G" returned: 0 in 0.143s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0c5c1005-5a96-4d0b-854d-c505559b71a5 tempest-VolumesExtendTest-548849589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.307s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:52 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0c5c1005-5a96-4d0b-854d-c505559b71a5 tempest-VolumesExtendTest-548849589 None] Extend volume completed successfully. Jul 06 12:14:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-0fe67a37-8b79-40b5-89ce-631b1b3cf817 req-4964250d-2861-4491-9a43-e8dc83099c5e tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-0fe67a37-8b79-40b5-89ce-631b1b3cf817 req-4964250d-2861-4491-9a43-e8dc83099c5e tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:53 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ddc70f-658a-4529-ae37-c49f55b5f634]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-0fe67a37-8b79-40b5-89ce-631b1b3cf817 req-4964250d-2861-4491-9a43-e8dc83099c5e tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7eb1613f-efe5-4a22-a043-b5a802e5d495 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:53 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.951s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:14:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:14:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:14:53 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7eb1613f-efe5-4a22-a043-b5a802e5d495 Jul 06 12:14:53 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Acquiring lock "cinder-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Lock "cinder-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Acquiring lock "cinder-quobyte-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Lock "cinder-quobyte-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7" acquired by "delete_volume" :: waited 0.015s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:53 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[38121379-86b0-4252-8acc-9cb0b8e64f36]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:54 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 Jul 06 12:14:54 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:54 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-0fe67a37-8b79-40b5-89ce-631b1b3cf817 req-4964250d-2861-4491-9a43-e8dc83099c5e tempest-AttachVolumeNegativeTest-1291209686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7eb1613f-efe5-4a22-a043-b5a802e5d495" returned: 0 in 1.229s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-0fe67a37-8b79-40b5-89ce-631b1b3cf817 req-4964250d-2861-4491-9a43-e8dc83099c5e tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.252s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-0fe67a37-8b79-40b5-89ce-631b1b3cf817 req-4964250d-2861-4491-9a43-e8dc83099c5e tempest-AttachVolumeNegativeTest-1291209686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-7eb1613f-efe5-4a22-a043-b5a802e5d495', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2edf4c7a-fc5a-4a4c-8d98-1551267a4b90', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:14:54 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-0fe67a37-8b79-40b5-89ce-631b1b3cf817 req-4964250d-2861-4491-9a43-e8dc83099c5e tempest-AttachVolumeNegativeTest-1291209686 None] attachment_update completed successfully. Jul 06 12:14:55 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7" returned: 0 in 1.222s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:55 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 Jul 06 12:14:55 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:56 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7" returned: 1 in 0.922s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:14:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:56 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7 Jul 06 12:14:56 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:56 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7" returned: 0 in 0.734s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:56 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Lock "cinder-quobyte-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7" released by "delete_volume" :: held 2.986s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:56 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Created reservations ['78f6edee-45e8-42c6-a49b-dd7c390e9fb5', '75d3a2dd-fd6c-46a7-b7f9-fbadcef4cbbd', 'b9451ea3-ef53-4c27-9690-954f194ec517', 'e315ed6d-ef63-4719-82d5-bf27c3140441'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:57 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:14:57 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Flow 'volume_create_manager' (23f9e575-67fd-4978-8531-e71da78b1bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9476f053-d176-4ae9-91c2-c664627843d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9476f053-d176-4ae9-91c2-c664627843d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1554297423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b5eef3-3674-4d50-a523-2e10eb09e934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1812d7730148dbaf092b55fdb727b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:58Z,use_quota=True,user_id='79a1bd9f56794cfbb9b4c3e570aa8d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17db4ca3-37cc-4436-9fee-de7e1b1d604a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17db4ca3-37cc-4436-9fee-de7e1b1d604a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:57 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790e935f-1971-4698-8324-df88fe3ea473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790e935f-1971-4698-8324-df88fe3ea473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58b5eef3-3674-4d50-a523-2e10eb09e934', 'volume_name': 'volume-58b5eef3-3674-4d50-a523-2e10eb09e934', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be51d8c-797c-4bf4-9004-bea592887eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be51d8c-797c-4bf4-9004-bea592887eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2b318c-448b-4ebb-94a0-0d33310be275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:57 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Volume 58b5eef3-3674-4d50-a523-2e10eb09e934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58b5eef3-3674-4d50-a523-2e10eb09e934', 'volume_size': 1} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1554297423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b5eef3-3674-4d50-a523-2e10eb09e934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1812d7730148dbaf092b55fdb727b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:58Z,use_quota=True,user_id='79a1bd9f56794cfbb9b4c3e570aa8d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Creating volume 58b5eef3-3674-4d50-a523-2e10eb09e934 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:57 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:14:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.987s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:58 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:58 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Deleted volume successfully. Jul 06 12:14:58 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934 1073741824 Jul 06 12:14:58 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6a103ea-030a-4460-841f-68d42e81e4b2 tempest-VolumesExtendTest-548849589 None] Lock "cinder-5fae8a5b-508a-4be0-86eb-ce0fc9e9e2f7-delete_volume" released by "delete_volume" :: held 4.223s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:59 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934 1073741824" returned: 0 in 1.052s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:59 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934 Jul 06 12:14:59 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:59 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-1508c103-da9a-4e15-a56c-2998040dbfb7 req-86c6e597-8f27-409d-9629-dfeca93468e9 tempest-AttachVolumeTestJSON-2137043288 None] Terminate volume connection completed successfully. Jul 06 12:14:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-1508c103-da9a-4e15-a56c-2998040dbfb7 req-86c6e597-8f27-409d-9629-dfeca93468e9 tempest-AttachVolumeTestJSON-2137043288 None] Deleting attachment 412bdcac-76d8-476d-81e5-80159a4168f0. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:14:59 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934" returned: 0 in 0.784s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:14:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2b318c-448b-4ebb-94a0-0d33310be275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b5eef3-3674-4d50-a523-2e10eb09e934', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2e5488-b4fc-4f21-a5c2-42acb6cd90cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:59 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Volume volume-58b5eef3-3674-4d50-a523-2e10eb09e934 (58b5eef3-3674-4d50-a523-2e10eb09e934): created successfully Jul 06 12:14:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2e5488-b4fc-4f21-a5c2-42acb6cd90cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Flow 'volume_create_manager' (23f9e575-67fd-4978-8531-e71da78b1bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:59 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-66240a02-4294-4e14-8308-c0fa14bcf59e tempest-VolumesExtendTest-548849589 None] Created volume successfully. Jul 06 12:15:00 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-662184d5-09de-4c72-ad5d-ecfeabf7b9df req-aae61717-e1f2-4c22-ab6e-6696966cbc49 tempest-AttachVolumeNegativeTest-1291209686 None] Terminate volume connection completed successfully. Jul 06 12:15:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-662184d5-09de-4c72-ad5d-ecfeabf7b9df req-aae61717-e1f2-4c22-ab6e-6696966cbc49 tempest-AttachVolumeNegativeTest-1291209686 None] Deleting attachment 2edf4c7a-fc5a-4a4c-8d98-1551267a4b90. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:15:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:01 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2383d55-db6e-413f-b6e8-00c7d824ac08]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:01 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee Jul 06 12:15:01 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:02 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" returned: 0 in 0.931s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:02 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16ce89d-b3f9-4d48-9ada-b0d44131da58]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:02 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee Jul 06 12:15:02 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:03 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" returned: 0 in 0.935s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.9fe5f621-9cd3-4721-bc4c-bf119b0da571kit9x8k8.img {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:03 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.9fe5f621-9cd3-4721-bc4c-bf119b0da571kit9x8k8.img Jul 06 12:15:03 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:09 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.9fe5f621-9cd3-4721-bc4c-bf119b0da571kit9x8k8.img" returned: 0 in 6.056s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:09 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3369c58-cc54-4258-b140-7191bd2a359a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:09 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee Jul 06 12:15:09 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:10 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" returned: 0 in 1.154s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:10 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.9fe5f621-9cd3-4721-bc4c-bf119b0da571kit9x8k8.img {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:15:10 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] Converted 1024.00 MB image at 169.02 MB/s Jul 06 12:15:10 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] 9fe5f621-9cd3-4721-bc4c-bf119b0da571 was raw, no need to convert to raw {{(pid=86761) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 06 12:15:20 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=41,cinder:INSERT=10,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:15:20 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=26,cinder:SELECT=28,cinder:DELETE=3,cinder:INSERT=11 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:15:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.808s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] Uploaded volume to glance image-id: 9fe5f621-9cd3-4721-bc4c-bf119b0da571. {{(pid=86761) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 12:15:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 33.586s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] Creating offline snapshot cde01378-aa57-4a3f-8b91-7e3863144743 of volume 58b5eef3-3674-4d50-a523-2e10eb09e934 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:15:35 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-3841b54e-2155-4492-bd93-14b4eac5468f tempest-VolumesActionsTest-1559946920 None] Copy volume to image completed successfully. Jul 06 12:15:35 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[819a2ba9-bf7b-451e-820d-33008e069db1]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:35 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934 Jul 06 12:15:35 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:36 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934" returned: 0 in 1.196s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:36 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 1G Jul 06 12:15:36 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:38 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 1G" returned: 0 in 1.796s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58b5eef3-3674-4d50-a523-2e10eb09e934 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:38 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58b5eef3-3674-4d50-a523-2e10eb09e934 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 Jul 06 12:15:38 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:39 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58b5eef3-3674-4d50-a523-2e10eb09e934 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743" returned: 0 in 0.965s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:39 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 is being set with open permissions: ugo+rw Jul 06 12:15:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:39 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 Jul 06 12:15:39 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:40 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743" returned: 0 in 0.986s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:40 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.info Jul 06 12:15:40 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:41 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.info" returned: 0 in 1.044s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:41 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.info is being set with open permissions: ugo+rw Jul 06 12:15:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:41 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.info Jul 06 12:15:41 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:42 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.info" returned: 0 in 0.857s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.020s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.825s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:42 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[937bcbdf-14c0-468c-a339-242a4c52cdfe]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:42 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a5553a3f-51c2-469e-ae23-2d6d188bd723 tempest-VolumesExtendTest-548849589 None] Create snapshot completed successfully Jul 06 12:15:42 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee Jul 06 12:15:42 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:43 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" returned: 0 in 0.772s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:43 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[610630de-df7c-45df-bf9b-ea5c970a4b07]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:43 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee Jul 06 12:15:43 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a9e84677-0ea0-42f9-ae62-a49ec8afb7e1 tempest-VolumesExtendTest-548849589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:44 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" returned: 0 in 0.876s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.d375a3cb-8678-4cbb-9975-571b0ac2a048ppe3whh3.img {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:44 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.d375a3cb-8678-4cbb-9975-571b0ac2a048ppe3whh3.img Jul 06 12:15:44 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:50 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.d375a3cb-8678-4cbb-9975-571b0ac2a048ppe3whh3.img" returned: 0 in 6.028s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:50 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d655af8-5622-4e7d-9f33-ca01230a2e5e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:50 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee Jul 06 12:15:50 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:50 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:INSERT=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:15:51 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" returned: 0 in 1.160s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:51 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.d375a3cb-8678-4cbb-9975-571b0ac2a048ppe3whh3.img {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:15:51 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Converted 1024.00 MB image at 169.85 MB/s Jul 06 12:15:51 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] d375a3cb-8678-4cbb-9975-571b0ac2a048 was raw, converting to qcow2 {{(pid=86761) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 06 12:15:51 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15631ff-0980-45b0-afec-ad5860bec591]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.d375a3cb-8678-4cbb-9975-571b0ac2a048ppe3whh3.img {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:51 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.d375a3cb-8678-4cbb-9975-571b0ac2a048ppe3whh3.img Jul 06 12:15:51 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:52 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.d375a3cb-8678-4cbb-9975-571b0ac2a048ppe3whh3.img" returned: 0 in 0.817s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.d375a3cb-8678-4cbb-9975-571b0ac2a048ppe3whh3.img {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:52 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.d375a3cb-8678-4cbb-9975-571b0ac2a048ppe3whh3.img Jul 06 12:15:52 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:52 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:15:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:15:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:52 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:15:52 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:53 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.d375a3cb-8678-4cbb-9975-571b0ac2a048ppe3whh3.img" returned: 1 in 0.880s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.d375a3cb-8678-4cbb-9975-571b0ac2a048ppe3whh3.img' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:15:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.d375a3cb-8678-4cbb-9975-571b0ac2a048ppe3whh3.img /opt/stack/data/cinder/conversion/vol_upload_twp5b408 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:53 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.d375a3cb-8678-4cbb-9975-571b0ac2a048ppe3whh3.img /opt/stack/data/cinder/conversion/vol_upload_twp5b408 Jul 06 12:15:53 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:53 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.827s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:15:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:15:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:15:53 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.d375a3cb-8678-4cbb-9975-571b0ac2a048ppe3whh3.img /opt/stack/data/cinder/conversion/vol_upload_twp5b408" returned: 0 in 0.787s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:53 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Image conversion details: src /opt/stack/data/cinder/conversion/2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee.temp_image.d375a3cb-8678-4cbb-9975-571b0ac2a048ppe3whh3.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_twp5b408 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:15:53 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 06 12:15:53 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[65658c4e-b390-41a5-a0ea-73817d51472a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_twp5b408 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:53 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_twp5b408 Jul 06 12:15:53 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:54 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_twp5b408" returned: 0 in 0.826s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Uploaded volume to glance image-id: d375a3cb-8678-4cbb-9975-571b0ac2a048. {{(pid=86761) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 12:15:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a9e84677-0ea0-42f9-ae62-a49ec8afb7e1 tempest-VolumesExtendTest-548849589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 12.977s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:56 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[addd8cbf-7b40-4e8e-a3dd-caa6214d36b0]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a9e84677-0ea0-42f9-ae62-a49ec8afb7e1 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:56 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c75032c2-e94e-44e3-8617-61da3c09292e tempest-VolumesActionsTest-1559946920 None] Copy volume to image completed successfully. Jul 06 12:15:56 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934 Jul 06 12:15:56 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:57 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a9e84677-0ea0-42f9-ae62-a49ec8afb7e1 tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934" returned: 0 in 0.898s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a9e84677-0ea0-42f9-ae62-a49ec8afb7e1 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 2G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Acquiring lock "cinder-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Lock "cinder-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Acquiring lock "cinder-quobyte-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Lock "cinder-quobyte-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" acquired by "delete_volume" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:57 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[681a33b1-bff2-41c8-a798-78f8ba56ace0]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a9e84677-0ea0-42f9-ae62-a49ec8afb7e1 tempest-VolumesExtendTest-548849589 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 2G" returned: 0 in 0.196s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a9e84677-0ea0-42f9-ae62-a49ec8afb7e1 tempest-VolumesExtendTest-548849589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.146s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:57 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a9e84677-0ea0-42f9-ae62-a49ec8afb7e1 tempest-VolumesExtendTest-548849589 None] Extend volume completed successfully. Jul 06 12:15:57 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee Jul 06 12:15:57 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Acquiring lock "cinder-cde01378-aa57-4a3f-8b91-7e3863144743-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Lock "cinder-cde01378-aa57-4a3f-8b91-7e3863144743-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Acquiring lock "cinder-quobyte-58b5eef3-3674-4d50-a523-2e10eb09e934" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Lock "cinder-quobyte-58b5eef3-3674-4d50-a523-2e10eb09e934" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Acquiring lock "cinder-quobyte-cde01378-aa57-4a3f-8b91-7e3863144743" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Lock "cinder-quobyte-cde01378-aa57-4a3f-8b91-7e3863144743" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Deleting offline snapshot cde01378-aa57-4a3f-8b91-7e3863144743 of volume 58b5eef3-3674-4d50-a523-2e10eb09e934 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:15:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] snapshot_file for this snap is: volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:15:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e02dc6-0ee1-41e8-9d92-e76825c02060]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:58 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" returned: 0 in 0.943s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:58 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee Jul 06 12:15:58 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:58 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 Jul 06 12:15:58 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:59 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" returned: 0 in 0.927s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Lock "cinder-quobyte-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee" released by "delete_volume" :: held 1.930s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:59 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743" returned: 0 in 1.089s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58b5eef3-3674-4d50-a523-2e10eb09e934(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:15:59 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89bc05b-73c9-4ed8-8651-fbb4aa381d27]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:59 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Created reservations ['1a328cda-0f7f-43d9-a29d-68151aa07afb', '168090cd-fefd-4fdb-b8f9-d31ac6f6afe1', '7c868b0d-b339-4b6b-b97f-c5d61776c9c1', '0da65fd5-0d02-46a7-80f3-880715f84485'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:59 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934 Jul 06 12:15:59 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:59 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:15:59 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:00 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Flow 'volume_create_manager' (3348a434-6699-4025-bcf6-6dad5405f159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7840659-98dd-4738-9acc-979777ecfdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7840659-98dd-4738-9acc-979777ecfdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1054416046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67cc1ded-4b10-4a8c-b91f-7eff74a380ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e28233ad20d24f169a37a59f941fe686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:01Z,use_quota=True,user_id='fe8cd664886b4b21ba0063111fc4c49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8cbf54-3c95-45f3-8fc6-394a20b1c5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8cbf54-3c95-45f3-8fc6-394a20b1c5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea96697-345f-4311-8a8a-89ad35be95d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea96697-345f-4311-8a8a-89ad35be95d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67cc1ded-4b10-4a8c-b91f-7eff74a380ee', 'volume_name': 'volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a01d9e-fbea-416d-bf67-4a7fb5207959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a01d9e-fbea-416d-bf67-4a7fb5207959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b541618e-db92-4f9e-9f45-02db5f1683cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:01 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Volume 67cc1ded-4b10-4a8c-b91f-7eff74a380ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee', 'volume_size': 1} Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1054416046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67cc1ded-4b10-4a8c-b91f-7eff74a380ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e28233ad20d24f169a37a59f941fe686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:01Z,use_quota=True,user_id='fe8cd664886b4b21ba0063111fc4c49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Creating volume 67cc1ded-4b10-4a8c-b91f-7eff74a380ee {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:01 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:01 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee 1073741824 Jul 06 12:16:01 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934" returned: 0 in 1.791s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:01 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:01 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 Jul 06 12:16:01 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:01 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.694s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:01 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Deleted volume successfully. Jul 06 12:16:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4bd315b8-cae0-4f65-93f8-3f7affe422b2 tempest-VolumesActionsTest-1559946920 None] Lock "cinder-2a7dffab-d412-4f78-b3a4-53bdcb3ed1ee-delete_volume" released by "delete_volume" :: held 4.069s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:02 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee 1073741824" returned: 0 in 1.125s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:02 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee Jul 06 12:16:02 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:02 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743" returned: 0 in 1.163s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:02 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743 Jul 06 12:16:02 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:03 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee" returned: 0 in 0.816s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b541618e-db92-4f9e-9f45-02db5f1683cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dbea829-84b8-49f9-bd7c-ccf81560a5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:03 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Volume volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee (67cc1ded-4b10-4a8c-b91f-7eff74a380ee): created successfully Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dbea829-84b8-49f9-bd7c-ccf81560a5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Flow 'volume_create_manager' (3348a434-6699-4025-bcf6-6dad5405f159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:03 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-38f4fa3f-aacf-41c2-b45e-d50be0a7ef03 tempest-AttachVolumeNegativeTest-1291209686 None] Created volume successfully. Jul 06 12:16:03 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934.cde01378-aa57-4a3f-8b91-7e3863144743" returned: 0 in 0.774s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Lock "cinder-quobyte-cde01378-aa57-4a3f-8b91-7e3863144743" released by "_delete_snapshot" :: held 4.981s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Lock "cinder-quobyte-58b5eef3-3674-4d50-a523-2e10eb09e934" released by "delete_snapshot" :: held 5.013s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Created reservations ['9ab51fdb-706f-490c-90ce-1279cd7e8aef', '7592c5cb-2094-4022-ae78-495672190c93', 'ad612467-2ae5-4526-b12b-915620c780f1', '884cd1fc-d617-46a6-92bb-298a61d6d721'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:03 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Delete snapshot completed successfully. Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f2c887d4-0db3-4797-bd1e-85576b4cb813 tempest-VolumesExtendTest-548849589 None] Lock "cinder-cde01378-aa57-4a3f-8b91-7e3863144743-delete_snapshot" released by "delete_snapshot" :: held 5.221s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Acquiring lock "cinder-58b5eef3-3674-4d50-a523-2e10eb09e934-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Lock "cinder-58b5eef3-3674-4d50-a523-2e10eb09e934-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Acquiring lock "cinder-quobyte-58b5eef3-3674-4d50-a523-2e10eb09e934" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Lock "cinder-quobyte-58b5eef3-3674-4d50-a523-2e10eb09e934" acquired by "delete_volume" :: waited 0.038s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd52a43-253d-45de-8e95-803dfc996f6b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:04 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934 Jul 06 12:16:04 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:05 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934" returned: 0 in 1.138s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:05 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934 Jul 06 12:16:05 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:06 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-58b5eef3-3674-4d50-a523-2e10eb09e934" returned: 0 in 0.976s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Lock "cinder-quobyte-58b5eef3-3674-4d50-a523-2e10eb09e934" released by "delete_volume" :: held 2.284s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:06 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Created reservations ['7cd18bfa-15cc-4151-9339-fae929dd23b6', '765f2b2e-7573-4237-bd0e-2de13fe09295', 'a8c00615-88e0-4542-9537-862c8ce8eabb', '3f520150-0ede-4c2b-be92-a3a496c96918'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:06 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:16:06 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:07 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.923s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:07 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:07 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Deleted volume successfully. Jul 06 12:16:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1b11119e-2002-443f-8f24-d6736c1db2c9 tempest-VolumesExtendTest-548849589 None] Lock "cinder-58b5eef3-3674-4d50-a523-2e10eb09e934-delete_volume" released by "delete_volume" :: held 3.574s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-20564aca-ca04-49f8-8584-5c7e0283d0b2 req-93793fa3-df03-4a7f-a0e7-890b076e0c81 tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-20564aca-ca04-49f8-8584-5c7e0283d0b2 req-93793fa3-df03-4a7f-a0e7-890b076e0c81 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:07 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f14dcf4-67f5-43af-96b2-235b28bf5915]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-20564aca-ca04-49f8-8584-5c7e0283d0b2 req-93793fa3-df03-4a7f-a0e7-890b076e0c81 tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:07 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee Jul 06 12:16:07 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:08 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-20564aca-ca04-49f8-8584-5c7e0283d0b2 req-93793fa3-df03-4a7f-a0e7-890b076e0c81 tempest-AttachVolumeNegativeTest-1291209686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee" returned: 0 in 1.355s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-20564aca-ca04-49f8-8584-5c7e0283d0b2 req-93793fa3-df03-4a7f-a0e7-890b076e0c81 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.382s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-20564aca-ca04-49f8-8584-5c7e0283d0b2 req-93793fa3-df03-4a7f-a0e7-890b076e0c81 tempest-AttachVolumeNegativeTest-1291209686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '345d0f90-0af8-45fa-9c54-1ead5c3f1835', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:16:09 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-20564aca-ca04-49f8-8584-5c7e0283d0b2 req-93793fa3-df03-4a7f-a0e7-890b076e0c81 tempest-AttachVolumeNegativeTest-1291209686 None] attachment_update completed successfully. Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Flow 'volume_create_manager' (55060e63-71bf-4476-b4c5-8988e25f3823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e43bee5-13a5-46b3-9d71-258294eba00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e43bee5-13a5-46b3-9d71-258294eba00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1506346081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a398e8-edad-4c90-994d-72156c9e416b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca07a399e08c4c269c87e4eddc9797ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:10Z,use_quota=True,user_id='9341eea46d8c47ce92f77cdfb81394c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78792d44-155e-445d-9ffb-fb310041dfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78792d44-155e-445d-9ffb-fb310041dfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337875d9-6bde-46f5-b087-1e78cf3b414f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337875d9-6bde-46f5-b087-1e78cf3b414f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a398e8-edad-4c90-994d-72156c9e416b', 'volume_name': 'volume-61a398e8-edad-4c90-994d-72156c9e416b', 'volume_size': 2}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3929287f-106d-4c91-a407-5dec45a4ccbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3929287f-106d-4c91-a407-5dec45a4ccbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aba427a-517a-4d28-a535-74459b33bf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:10 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Volume 61a398e8-edad-4c90-994d-72156c9e416b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a398e8-edad-4c90-994d-72156c9e416b', 'volume_size': 2} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1506346081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a398e8-edad-4c90-994d-72156c9e416b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca07a399e08c4c269c87e4eddc9797ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:10Z,use_quota=True,user_id='9341eea46d8c47ce92f77cdfb81394c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Creating volume 61a398e8-edad-4c90-994d-72156c9e416b {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:10 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:16:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-61a398e8-edad-4c90-994d-72156c9e416b 2147483648 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:10 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-61a398e8-edad-4c90-994d-72156c9e416b 2147483648 Jul 06 12:16:10 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:11 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-61a398e8-edad-4c90-994d-72156c9e416b 2147483648" returned: 0 in 1.346s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-61a398e8-edad-4c90-994d-72156c9e416b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:11 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-61a398e8-edad-4c90-994d-72156c9e416b Jul 06 12:16:11 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:12 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Flow 'volume_create_manager' (7c30648c-76ab-4c6b-9e7d-9a67d7d86ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9573a309-c0c8-4044-861c-b91805e12fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-61a398e8-edad-4c90-994d-72156c9e416b" returned: 0 in 0.962s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] <== create_volume: return (2377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.385s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9573a309-c0c8-4044-861c-b91805e12fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-913696770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd974edd-10e4-4f53-94f1-2b5a10ec01c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='568aa862b2154188ba35a49fd8d0f8ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:12Z,use_quota=True,user_id='9103ad962d37492d804175b7d1d9aaf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4affa331-00e5-4e0d-9679-0ae85ca1c63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4affa331-00e5-4e0d-9679-0ae85ca1c63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075a718e-8b9c-4acd-949b-46b88ae3f398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075a718e-8b9c-4acd-949b-46b88ae3f398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd974edd-10e4-4f53-94f1-2b5a10ec01c2', 'volume_name': 'volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2159ff7-6f12-434f-ba05-78dfca3732e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2159ff7-6f12-434f-ba05-78dfca3732e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b93549c-92b0-451c-9bbc-1fb6021f06da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:12 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Volume cd974edd-10e4-4f53-94f1-2b5a10ec01c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2', 'volume_size': 1} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-913696770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd974edd-10e4-4f53-94f1-2b5a10ec01c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='568aa862b2154188ba35a49fd8d0f8ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:12Z,use_quota=True,user_id='9103ad962d37492d804175b7d1d9aaf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Creating volume cd974edd-10e4-4f53-94f1-2b5a10ec01c2 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:12 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aba427a-517a-4d28-a535-74459b33bf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a398e8-edad-4c90-994d-72156c9e416b', 'volume_size': 2}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93c84d3-e229-4131-beff-23fb5aca377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:12 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2 1073741824 Jul 06 12:16:12 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:12 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Volume volume-61a398e8-edad-4c90-994d-72156c9e416b (61a398e8-edad-4c90-994d-72156c9e416b): created successfully Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93c84d3-e229-4131-beff-23fb5aca377a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Flow 'volume_create_manager' (55060e63-71bf-4476-b4c5-8988e25f3823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:12 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-06ffb89a-25f3-4c5f-ba2e-4906ff869bfe tempest-VolumesCloneNegativeTest-1902703760 None] Created volume successfully. Jul 06 12:16:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Acquiring lock "cinder-61a398e8-edad-4c90-994d-72156c9e416b-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Lock "cinder-61a398e8-edad-4c90-994d-72156c9e416b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Acquiring lock "cinder-quobyte-61a398e8-edad-4c90-994d-72156c9e416b" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Lock "cinder-quobyte-61a398e8-edad-4c90-994d-72156c9e416b" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:13 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b172ef-9c51-4607-96b2-729404916ec4]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-61a398e8-edad-4c90-994d-72156c9e416b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:13 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-61a398e8-edad-4c90-994d-72156c9e416b Jul 06 12:16:13 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:13 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2 1073741824" returned: 0 in 1.180s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:13 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2 Jul 06 12:16:13 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:14 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-61a398e8-edad-4c90-994d-72156c9e416b" returned: 0 in 1.133s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-61a398e8-edad-4c90-994d-72156c9e416b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:14 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-61a398e8-edad-4c90-994d-72156c9e416b Jul 06 12:16:14 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:14 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2" returned: 0 in 0.920s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] <== create_volume: return (2159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b93549c-92b0-451c-9bbc-1fb6021f06da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce528335-2e53-4db0-bff8-66bcc18a00bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:14 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Volume volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2 (cd974edd-10e4-4f53-94f1-2b5a10ec01c2): created successfully Jul 06 12:16:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce528335-2e53-4db0-bff8-66bcc18a00bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Flow 'volume_create_manager' (7c30648c-76ab-4c6b-9e7d-9a67d7d86ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:14 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6de07c00-183b-49b7-8d9a-a6a2ddf22f62 tempest-VolumesNegativeTest-1846396330 None] Created volume successfully. Jul 06 12:16:15 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-61a398e8-edad-4c90-994d-72156c9e416b" returned: 0 in 0.723s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Lock "cinder-quobyte-61a398e8-edad-4c90-994d-72156c9e416b" released by "delete_volume" :: held 1.919s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:15 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Created reservations ['034994b7-a074-4331-8491-5912dcc9e2cf', '5c520a25-b0f1-4377-a1d5-c000b5a73fc6', '4ef38020-a475-4484-a5a9-705285c61e8e', 'f1dd5403-2f2b-444c-83ca-017b13399343'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:15 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:16:15 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:16 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-a887fd50-8929-45d3-b745-b7f5b32d8955 req-3b4f6edf-2afe-45fd-8a77-926d21fcc5bd tempest-AttachVolumeNegativeTest-1291209686 None] Terminate volume connection completed successfully. Jul 06 12:16:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-a887fd50-8929-45d3-b745-b7f5b32d8955 req-3b4f6edf-2afe-45fd-8a77-926d21fcc5bd tempest-AttachVolumeNegativeTest-1291209686 None] Deleting attachment 345d0f90-0af8-45fa-9c54-1ead5c3f1835. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:16:16 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.926s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:16 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:16 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Deleted volume successfully. Jul 06 12:16:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-14a52a09-bb02-4269-a74b-7b702d93e7e2 tempest-VolumesCloneNegativeTest-1902703760 None] Lock "cinder-61a398e8-edad-4c90-994d-72156c9e416b-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Flow 'volume_create_manager' (27dbef07-1583-49ee-9976-e18e909dd357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b870ecac-6e01-4ca3-9456-8227b682e7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b870ecac-6e01-4ca3-9456-8227b682e7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-184820218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc443008-6c9b-482e-94d3-bdee42e60345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826ecaf07c304946b655ee8f66912568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:20Z,use_quota=True,user_id='5a80940f5794491a92507ced91e42a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469d9e42-d0f4-47d1-9f83-96b6704bde1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469d9e42-d0f4-47d1-9f83-96b6704bde1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f494d627-912d-4322-a6fb-48276fddd931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f494d627-912d-4322-a6fb-48276fddd931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc443008-6c9b-482e-94d3-bdee42e60345', 'volume_name': 'volume-bc443008-6c9b-482e-94d3-bdee42e60345', 'volume_size': 2}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22528917-d3cc-4a5a-bb05-4367773b3c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22528917-d3cc-4a5a-bb05-4367773b3c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a21907-e295-476c-b7b9-d1709188a841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:20 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Volume bc443008-6c9b-482e-94d3-bdee42e60345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc443008-6c9b-482e-94d3-bdee42e60345', 'volume_size': 2} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-184820218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc443008-6c9b-482e-94d3-bdee42e60345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826ecaf07c304946b655ee8f66912568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:20Z,use_quota=True,user_id='5a80940f5794491a92507ced91e42a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Creating volume bc443008-6c9b-482e-94d3-bdee42e60345 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:20 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:16:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345 2147483648 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:20 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345 2147483648 Jul 06 12:16:20 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:22 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345 2147483648" returned: 0 in 1.322s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:22 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345 Jul 06 12:16:22 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:23 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345" returned: 0 in 0.967s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] <== create_volume: return (2396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.399s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a21907-e295-476c-b7b9-d1709188a841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc443008-6c9b-482e-94d3-bdee42e60345', 'volume_size': 2}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24ba784-ba27-41a1-86db-5a7d5935635c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:23 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Volume volume-bc443008-6c9b-482e-94d3-bdee42e60345 (bc443008-6c9b-482e-94d3-bdee42e60345): created successfully Jul 06 12:16:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24ba784-ba27-41a1-86db-5a7d5935635c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Flow 'volume_create_manager' (27dbef07-1583-49ee-9976-e18e909dd357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:23 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-fd07a618-f8a5-4130-85ae-ec78055bc007 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Created volume successfully. Jul 06 12:16:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Creating offline snapshot 14091189-87ff-4ee4-91a5-10d67dd9647f of volume bc443008-6c9b-482e-94d3-bdee42e60345 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:16:23 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba44044c-5cc6-468c-97a4-26e683b407e7]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:24 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345 Jul 06 12:16:24 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345" returned: 0 in 0.985s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:24 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f 2G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:24 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f 2G Jul 06 12:16:24 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:26 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f 2G" returned: 0 in 1.098s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc443008-6c9b-482e-94d3-bdee42e60345 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:26 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc443008-6c9b-482e-94d3-bdee42e60345 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f Jul 06 12:16:26 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:26 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc443008-6c9b-482e-94d3-bdee42e60345 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f" returned: 0 in 0.836s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:26 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f is being set with open permissions: ugo+rw Jul 06 12:16:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:26 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f Jul 06 12:16:26 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:27 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f" returned: 0 in 0.771s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:27 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.info Jul 06 12:16:27 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "cinder-67cc1ded-4b10-4a8c-b91f-7eff74a380ee-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "cinder-67cc1ded-4b10-4a8c-b91f-7eff74a380ee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "cinder-quobyte-67cc1ded-4b10-4a8c-b91f-7eff74a380ee" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "cinder-quobyte-67cc1ded-4b10-4a8c-b91f-7eff74a380ee" acquired by "delete_volume" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:27 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc492225-fce8-41d3-b1df-a8f6886ea91b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:27 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee Jul 06 12:16:27 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:28 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.info" returned: 0 in 0.744s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:28 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.info is being set with open permissions: ugo+rw Jul 06 12:16:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:28 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.info Jul 06 12:16:28 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:28 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee" returned: 0 in 0.837s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:28 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee Jul 06 12:16:28 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:29 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.info" returned: 0 in 0.758s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.327s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:29 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ec3adde1-ffbd-4e7b-977c-9de15e8608b9 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Create snapshot completed successfully Jul 06 12:16:29 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-67cc1ded-4b10-4a8c-b91f-7eff74a380ee" returned: 0 in 0.766s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "cinder-quobyte-67cc1ded-4b10-4a8c-b91f-7eff74a380ee" released by "delete_volume" :: held 1.660s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:29 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Created reservations ['069acf8a-e269-42bb-a850-73b2c3bc65f4', 'b9e27743-65dd-4826-b3dc-7e44925adfcd', '41c4a06f-f550-43f9-8c3e-9eae3fdd89e8', '2c132316-b698-4d3b-910f-97c763e4edfa'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:29 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:16:29 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "cinder-7eb1613f-efe5-4a22-a043-b5a802e5d495-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Acquiring lock "cinder-14091189-87ff-4ee4-91a5-10d67dd9647f-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "cinder-7eb1613f-efe5-4a22-a043-b5a802e5d495-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "cinder-14091189-87ff-4ee4-91a5-10d67dd9647f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.104s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Acquiring lock "cinder-quobyte-bc443008-6c9b-482e-94d3-bdee42e60345" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "cinder-quobyte-bc443008-6c9b-482e-94d3-bdee42e60345" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Acquiring lock "cinder-quobyte-14091189-87ff-4ee4-91a5-10d67dd9647f" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "cinder-quobyte-7eb1613f-efe5-4a22-a043-b5a802e5d495" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "cinder-quobyte-14091189-87ff-4ee4-91a5-10d67dd9647f" acquired by "_delete_snapshot" :: waited 0.097s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Deleting offline snapshot 14091189-87ff-4ee4-91a5-10d67dd9647f of volume bc443008-6c9b-482e-94d3-bdee42e60345 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] snapshot_file for this snap is: volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "cinder-quobyte-7eb1613f-efe5-4a22-a043-b5a802e5d495" acquired by "delete_volume" :: waited 0.172s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b13c0a-22e3-467e-a874-0c9b0dfd3b3b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c177a8-1735-4330-86be-822127b37b65]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7eb1613f-efe5-4a22-a043-b5a802e5d495 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:31 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.515s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:31 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:31 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Deleted volume successfully. Jul 06 12:16:31 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7eb1613f-efe5-4a22-a043-b5a802e5d495 Jul 06 12:16:31 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:31 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f Jul 06 12:16:31 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4be1699b-44ce-4957-a1f8-6af81db86083 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "cinder-67cc1ded-4b10-4a8c-b91f-7eff74a380ee-delete_volume" released by "delete_volume" :: held 3.512s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:32 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7eb1613f-efe5-4a22-a043-b5a802e5d495" returned: 0 in 1.175s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7eb1613f-efe5-4a22-a043-b5a802e5d495 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:32 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7eb1613f-efe5-4a22-a043-b5a802e5d495 Jul 06 12:16:32 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:32 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f" returned: 0 in 1.330s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc443008-6c9b-482e-94d3-bdee42e60345(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7938725d-fb3a-4172-9918-a4fb1e664e9d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:32 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345 Jul 06 12:16:32 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Flow 'volume_create_manager' (f5ffe8f9-dc75-4af8-ae74-b3cf4ad81003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d7d27f-6b3a-47b8-8157-71d75af7ff57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d7d27f-6b3a-47b8-8157-71d75af7ff57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-982935562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf52848-5833-48ff-a625-36d1b543036a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f5e65222cc48148b8928e58ae0c0c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:33Z,use_quota=True,user_id='53b93f2057aa491c8e37175b3573e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db596c2-4816-41ac-bdba-a0137162982b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db596c2-4816-41ac-bdba-a0137162982b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e952ed76-dabd-4e3f-8619-8d15dc3d9fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e952ed76-dabd-4e3f-8619-8d15dc3d9fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cf52848-5833-48ff-a625-36d1b543036a', 'volume_name': 'volume-0cf52848-5833-48ff-a625-36d1b543036a', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a4fc92-36a3-4434-8cb7-cbd592d8b6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a4fc92-36a3-4434-8cb7-cbd592d8b6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1bec5a-f712-40d7-a961-677011db5f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:32 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Volume 0cf52848-5833-48ff-a625-36d1b543036a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cf52848-5833-48ff-a625-36d1b543036a', 'volume_size': 1} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-982935562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf52848-5833-48ff-a625-36d1b543036a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f5e65222cc48148b8928e58ae0c0c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:33Z,use_quota=True,user_id='53b93f2057aa491c8e37175b3573e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Creating volume 0cf52848-5833-48ff-a625-36d1b543036a {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:32 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:16:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0cf52848-5833-48ff-a625-36d1b543036a 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:33 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0cf52848-5833-48ff-a625-36d1b543036a 1073741824 Jul 06 12:16:33 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:33 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7eb1613f-efe5-4a22-a043-b5a802e5d495" returned: 0 in 1.048s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "cinder-quobyte-7eb1613f-efe5-4a22-a043-b5a802e5d495" released by "delete_volume" :: held 2.325s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:33 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Created reservations ['239fcbb7-d8f9-4fc2-81cf-4b2c265c992d', 'ce9d2304-d655-4ca5-be6c-628498375b6d', 'b288b2f2-249e-4b3f-82d7-5857440ca88c', 'b5292753-0edc-4b2b-9b38-89e0ffb75d38'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:33 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:16:33 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:33 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345" returned: 0 in 1.282s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:33 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f Jul 06 12:16:33 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:34 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0cf52848-5833-48ff-a625-36d1b543036a 1073741824" returned: 0 in 1.789s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "cinder-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Lock "cinder-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0cf52848-5833-48ff-a625-36d1b543036a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "cinder-quobyte-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:35 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0cf52848-5833-48ff-a625-36d1b543036a Jul 06 12:16:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Lock "cinder-quobyte-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73" acquired by "delete_volume" :: waited 0.035s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:35 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:35 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d82fa2-ca2e-470a-b61c-2e0ecadcd9c7]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:35 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73 Jul 06 12:16:35 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:35 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 2.108s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:35 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:35 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Deleted volume successfully. Jul 06 12:16:35 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f" returned: 0 in 1.947s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-44a9503e-48f8-49c5-b36e-cd98d021a363 tempest-AttachVolumeNegativeTest-1291209686 None] Lock "cinder-7eb1613f-efe5-4a22-a043-b5a802e5d495-delete_volume" released by "delete_volume" :: held 5.025s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:35 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f Jul 06 12:16:35 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:36 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0cf52848-5833-48ff-a625-36d1b543036a" returned: 0 in 1.659s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] <== create_volume: return (3598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.601s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1bec5a-f712-40d7-a961-677011db5f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf52848-5833-48ff-a625-36d1b543036a', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf21e89-870f-4f07-986a-38a53fe68071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:36 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Volume volume-0cf52848-5833-48ff-a625-36d1b543036a (0cf52848-5833-48ff-a625-36d1b543036a): created successfully Jul 06 12:16:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf21e89-870f-4f07-986a-38a53fe68071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Flow 'volume_create_manager' (f5ffe8f9-dc75-4af8-ae74-b3cf4ad81003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:36 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-665de5f3-6f54-474e-ac25-b54f883b5b6a tempest-AttachVolumeTestJSON-2137043288 None] Created volume successfully. Jul 06 12:16:36 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73" returned: 0 in 1.726s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:36 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345.14091189-87ff-4ee4-91a5-10d67dd9647f" returned: 0 in 1.383s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:36 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73 Jul 06 12:16:36 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "cinder-quobyte-14091189-87ff-4ee4-91a5-10d67dd9647f" released by "_delete_snapshot" :: held 6.277s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "cinder-quobyte-bc443008-6c9b-482e-94d3-bdee42e60345" released by "delete_snapshot" :: held 6.397s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:37 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Created reservations ['80ea0a78-36c4-4fff-9381-90d41de53a3b', '756fce1a-a5bc-4cdb-88f1-8f420d479629', '9155bed0-9fc2-4b22-a986-37ce70e38512', 'b5549f58-054b-449b-855f-251f4ab30418'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:37 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Delete snapshot completed successfully. Jul 06 12:16:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6d6cc22-d444-4d04-81f2-25794bc8b895 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "cinder-14091189-87ff-4ee4-91a5-10d67dd9647f-delete_snapshot" released by "delete_snapshot" :: held 6.750s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:37 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73" returned: 0 in 0.992s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Lock "cinder-quobyte-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73" released by "delete_volume" :: held 2.849s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:37 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Created reservations ['789149c4-1a98-474b-9fd0-f58fae82f275', '7dd19ed2-1efe-42e3-964a-c9d2bce856ac', '1330b77f-6b52-4c69-9bda-0b8e2d6059cd', '3f6280e6-a1b8-4692-880a-3caa230f5583'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:38 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:16:38 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Acquiring lock "cinder-bc443008-6c9b-482e-94d3-bdee42e60345-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "cinder-bc443008-6c9b-482e-94d3-bdee42e60345-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Acquiring lock "cinder-quobyte-bc443008-6c9b-482e-94d3-bdee42e60345" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "cinder-quobyte-bc443008-6c9b-482e-94d3-bdee42e60345" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:38 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b2ca99-b690-4e04-a9dd-7be61803233f]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:38 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345 Jul 06 12:16:38 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:38 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.777s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:38 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:38 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Deleted volume successfully. Jul 06 12:16:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-455ed40a-e26a-4703-aec7-edb918ef225c tempest-AttachVolumeNegativeTest-1291209686 None] Lock "cinder-83f7e60f-a0e6-41c6-9e23-78dfae0a2e73-delete_volume" released by "delete_volume" :: held 3.985s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:39 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345" returned: 0 in 1.042s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:39 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345 Jul 06 12:16:39 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:40 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bc443008-6c9b-482e-94d3-bdee42e60345" returned: 0 in 0.982s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "cinder-quobyte-bc443008-6c9b-482e-94d3-bdee42e60345" released by "delete_volume" :: held 2.133s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:40 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Created reservations ['8007c799-3083-4d64-8d0b-742f7de839fd', '3cd39a51-95b2-47e8-8bda-57e3c2d465c8', '50eb903a-8cfb-456d-bbbf-ecaf7d159338', 'f30a4305-2332-4a40-9322-95e84f198996'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:40 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:16:40 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-33c630da-f33d-4224-acbb-4d7e712aabb6 req-5e1ab0d4-34b7-45af-991a-c2bb754e226d tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-33c630da-f33d-4224-acbb-4d7e712aabb6 req-5e1ab0d4-34b7-45af-991a-c2bb754e226d tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:40 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a0e417-6440-416b-aecb-7ad34084bb0c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-33c630da-f33d-4224-acbb-4d7e712aabb6 req-5e1ab0d4-34b7-45af-991a-c2bb754e226d tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0cf52848-5833-48ff-a625-36d1b543036a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:40 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0cf52848-5833-48ff-a625-36d1b543036a Jul 06 12:16:40 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:41 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.871s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:41 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:41 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Deleted volume successfully. Jul 06 12:16:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-da8a2c1a-2f54-4a74-a626-4761277516b1 tempest-VolumesSnapshotNegativeTestJSON-1897944258 None] Lock "cinder-bc443008-6c9b-482e-94d3-bdee42e60345-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:41 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-33c630da-f33d-4224-acbb-4d7e712aabb6 req-5e1ab0d4-34b7-45af-991a-c2bb754e226d tempest-AttachVolumeTestJSON-2137043288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0cf52848-5833-48ff-a625-36d1b543036a" returned: 0 in 1.016s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-33c630da-f33d-4224-acbb-4d7e712aabb6 req-5e1ab0d4-34b7-45af-991a-c2bb754e226d tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.041s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-33c630da-f33d-4224-acbb-4d7e712aabb6 req-5e1ab0d4-34b7-45af-991a-c2bb754e226d tempest-AttachVolumeTestJSON-2137043288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-0cf52848-5833-48ff-a625-36d1b543036a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82835058-b910-4865-86ed-9460b19ee2dd', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:16:42 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-33c630da-f33d-4224-acbb-4d7e712aabb6 req-5e1ab0d4-34b7-45af-991a-c2bb754e226d tempest-AttachVolumeTestJSON-2137043288 None] attachment_update completed successfully. Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Flow 'volume_create_manager' (b2fc5e8a-42b4-440f-a566-b075d05cc036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3393587-2896-4529-a628-aa1707edabfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3393587-2896-4529-a628-aa1707edabfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1576476422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d8040f-b142-485b-9562-ded21e3cf683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014f3e353a7d4ceeb9697be7b9e7cfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:46Z,use_quota=True,user_id='a29bcea49b30452e919e29e7433d123c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c7411b-f2f4-4168-a966-3f788dc0e174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c7411b-f2f4-4168-a966-3f788dc0e174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18e4d1d-14af-4087-add6-41b046130686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18e4d1d-14af-4087-add6-41b046130686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06d8040f-b142-485b-9562-ded21e3cf683', 'volume_name': 'volume-06d8040f-b142-485b-9562-ded21e3cf683', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ed6184-6b65-46fb-a5a6-f1f98ad99730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ed6184-6b65-46fb-a5a6-f1f98ad99730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58870074-73ea-494e-99d7-b916b8941eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:45 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Volume 06d8040f-b142-485b-9562-ded21e3cf683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06d8040f-b142-485b-9562-ded21e3cf683', 'volume_size': 1} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1576476422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d8040f-b142-485b-9562-ded21e3cf683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014f3e353a7d4ceeb9697be7b9e7cfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:46Z,use_quota=True,user_id='a29bcea49b30452e919e29e7433d123c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Creating volume 06d8040f-b142-485b-9562-ded21e3cf683 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:45 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:16:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-06d8040f-b142-485b-9562-ded21e3cf683 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:46 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-06d8040f-b142-485b-9562-ded21e3cf683 1073741824 Jul 06 12:16:46 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:46 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Flow 'volume_create_manager' (0e43aff5-3ef3-4d76-a96a-cb962fa0af9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2134f670-3ddd-4530-a13a-0a2324dcde28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2134f670-3ddd-4530-a13a-0a2324dcde28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1515805582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07826c1-5e1c-4faf-a43b-2a37b8dc69a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014f3e353a7d4ceeb9697be7b9e7cfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:46Z,use_quota=True,user_id='a29bcea49b30452e919e29e7433d123c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e03b677-10bd-44fc-b793-df4278937073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e03b677-10bd-44fc-b793-df4278937073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127d6f0c-6b79-446e-b3a9-a704ab51c5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127d6f0c-6b79-446e-b3a9-a704ab51c5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a07826c1-5e1c-4faf-a43b-2a37b8dc69a0', 'volume_name': 'volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7e81fd-1dc5-435c-b927-fff450cef205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7e81fd-1dc5-435c-b927-fff450cef205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0658488d-7a88-4658-ae47-80f4757eecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:46 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Volume a07826c1-5e1c-4faf-a43b-2a37b8dc69a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0', 'volume_size': 1} Jul 06 12:16:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Flow 'volume_create_manager' (5819fea1-9739-4692-83f2-c063ce2d467d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f9ce1b-df37-4794-9a64-78e9e8470131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f9ce1b-df37-4794-9a64-78e9e8470131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-101350471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e177e4-8f35-4671-a16a-49553fac40f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014f3e353a7d4ceeb9697be7b9e7cfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:47Z,use_quota=True,user_id='a29bcea49b30452e919e29e7433d123c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82136417-8e9f-4ae1-a9c9-658116722580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82136417-8e9f-4ae1-a9c9-658116722580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026a04c2-2858-434c-8d5c-74b52d583b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026a04c2-2858-434c-8d5c-74b52d583b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68e177e4-8f35-4671-a16a-49553fac40f8', 'volume_name': 'volume-68e177e4-8f35-4671-a16a-49553fac40f8', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef44f9d-27b4-4fcc-938c-9687cf14df93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef44f9d-27b4-4fcc-938c-9687cf14df93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58417402-6467-4b9c-bea9-9c938cae5136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:47 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Volume 68e177e4-8f35-4671-a16a-49553fac40f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68e177e4-8f35-4671-a16a-49553fac40f8', 'volume_size': 1} Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:47 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-06d8040f-b142-485b-9562-ded21e3cf683 1073741824" returned: 0 in 1.736s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-06d8040f-b142-485b-9562-ded21e3cf683 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:47 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-06d8040f-b142-485b-9562-ded21e3cf683 Jul 06 12:16:47 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Flow 'volume_create_manager' (2b5fb37c-169b-4c5f-997f-9520075a2929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af65cdf4-7181-4e32-afde-56fb90391f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af65cdf4-7181-4e32-afde-56fb90391f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1937889787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb63968-c035-446f-b64c-593632a514a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014f3e353a7d4ceeb9697be7b9e7cfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:48Z,use_quota=True,user_id='a29bcea49b30452e919e29e7433d123c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6188ce45-4ab2-4862-8927-fc2ccc27437a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6188ce45-4ab2-4862-8927-fc2ccc27437a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f402d6aa-8a82-4bcd-838a-475fb3a51fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f402d6aa-8a82-4bcd-838a-475fb3a51fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb63968-c035-446f-b64c-593632a514a7', 'volume_name': 'volume-0bb63968-c035-446f-b64c-593632a514a7', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea206d6-58a9-4ff5-9d9b-e101397f208c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea206d6-58a9-4ff5-9d9b-e101397f208c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c7523d-1147-4a73-b796-9fecd34aaa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Volume 0bb63968-c035-446f-b64c-593632a514a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb63968-c035-446f-b64c-593632a514a7', 'volume_size': 1} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Flow 'volume_create_manager' (338a8d1b-dafd-4ed1-9a10-7600796119b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47f7ebe-52e1-48c0-a432-04ca8aeb0cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47f7ebe-52e1-48c0-a432-04ca8aeb0cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-28340645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fb933c-cbc6-44e5-83c3-0dbc00fde2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f5e65222cc48148b8928e58ae0c0c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:48Z,use_quota=True,user_id='53b93f2057aa491c8e37175b3573e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb09e31-8ed0-4988-8a0a-f052b5458d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb09e31-8ed0-4988-8a0a-f052b5458d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deed3064-5ca5-4d40-adad-89400f4f2652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deed3064-5ca5-4d40-adad-89400f4f2652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46fb933c-cbc6-44e5-83c3-0dbc00fde2e3', 'volume_name': 'volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e8fc34-adef-40fa-8362-e9818f79252a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e8fc34-adef-40fa-8362-e9818f79252a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d89ff981-d21e-4bde-880f-3821c4f7fee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Volume 46fb933c-cbc6-44e5-83c3-0dbc00fde2e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3', 'volume_size': 1} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-06d8040f-b142-485b-9562-ded21e3cf683" returned: 0 in 0.929s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] <== create_volume: return (2755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.758s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.117s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1515805582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07826c1-5e1c-4faf-a43b-2a37b8dc69a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014f3e353a7d4ceeb9697be7b9e7cfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:46Z,use_quota=True,user_id='a29bcea49b30452e919e29e7433d123c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Creating volume a07826c1-5e1c-4faf-a43b-2a37b8dc69a0 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:48 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:48 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0 1073741824 Jul 06 12:16:48 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Flow 'volume_create_manager' (f4727c1a-e19e-4e5d-98c2-6efa7020d1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d1481a-9f37-4abb-af10-cb60008ee2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58870074-73ea-494e-99d7-b916b8941eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d8040f-b142-485b-9562-ded21e3cf683', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fb07a0-7c76-444a-9f24-4939c7fdf44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d1481a-9f37-4abb-af10-cb60008ee2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2002204787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479ad109-9747-4dbb-80f2-0012de826edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014f3e353a7d4ceeb9697be7b9e7cfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:49Z,use_quota=True,user_id='a29bcea49b30452e919e29e7433d123c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ce4de9-b26f-4964-b1c8-9f88ccf98d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ce4de9-b26f-4964-b1c8-9f88ccf98d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d618f73b-4736-4194-8b8b-9d8db8e77ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d618f73b-4736-4194-8b8b-9d8db8e77ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '479ad109-9747-4dbb-80f2-0012de826edb', 'volume_name': 'volume-479ad109-9747-4dbb-80f2-0012de826edb', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ee13d2-045c-4a68-a221-7a881a3a0e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ee13d2-045c-4a68-a221-7a881a3a0e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828005c0-8f9b-44f3-960c-80fa287f6406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Volume 479ad109-9747-4dbb-80f2-0012de826edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-479ad109-9747-4dbb-80f2-0012de826edb', 'volume_size': 1} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:48 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Volume volume-06d8040f-b142-485b-9562-ded21e3cf683 (06d8040f-b142-485b-9562-ded21e3cf683): created successfully Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fb07a0-7c76-444a-9f24-4939c7fdf44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Flow 'volume_create_manager' (b2fc5e8a-42b4-440f-a566-b075d05cc036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:48 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-94b1d2e4-f8bd-405b-bea3-b598c1d9e889 tempest-CreateVolumesFromImageTest-97382494 None] Created volume successfully. Jul 06 12:16:49 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Flow 'volume_create_manager' (025c0430-a9ca-4ea9-a95a-d1d2191ff531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad88a8ff-a7df-42b8-bb68-e0e904f9978a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad88a8ff-a7df-42b8-bb68-e0e904f9978a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1916448933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2a5af4c4a8488ab0a1c1cbc3b34cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:49Z,use_quota=True,user_id='188f8ec2f597437ebf8f001aab0e3c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed0d30b-65de-43ef-b7f5-f6c5f15e23ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed0d30b-65de-43ef-b7f5-f6c5f15e23ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8013d47f-0045-47f9-9f7e-ca61983b9086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8013d47f-0045-47f9-9f7e-ca61983b9086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf', 'volume_name': 'volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344546cc-266b-4162-b59c-e8262bb34922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344546cc-266b-4162-b59c-e8262bb34922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11611d79-e61d-4df4-a7d4-f4d87c829afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:49 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Volume a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf', 'volume_size': 1} Jul 06 12:16:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:49 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0 1073741824" returned: 0 in 1.049s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:49 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0 Jul 06 12:16:49 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:50 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0" returned: 0 in 0.736s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.208s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-101350471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e177e4-8f35-4671-a16a-49553fac40f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014f3e353a7d4ceeb9697be7b9e7cfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:47Z,use_quota=True,user_id='a29bcea49b30452e919e29e7433d123c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Creating volume 68e177e4-8f35-4671-a16a-49553fac40f8 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:50 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-68e177e4-8f35-4671-a16a-49553fac40f8 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:50 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-68e177e4-8f35-4671-a16a-49553fac40f8 1073741824 Jul 06 12:16:50 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0658488d-7a88-4658-ae47-80f4757eecca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb623f5-0911-498f-905e-8991c057697a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=84,cinder:UPDATE=104,cinder:INSERT=15,cinder:DELETE=9 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:16:50 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Volume volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0 (a07826c1-5e1c-4faf-a43b-2a37b8dc69a0): created successfully Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb623f5-0911-498f-905e-8991c057697a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Flow 'volume_create_manager' (0e43aff5-3ef3-4d76-a96a-cb962fa0af9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:50 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ae5e0817-3f79-483a-a3db-ffdab2edd74f tempest-CreateVolumesFromImageTest-97382494 None] Created volume successfully. Jul 06 12:16:51 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-68e177e4-8f35-4671-a16a-49553fac40f8 1073741824" returned: 0 in 0.950s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-68e177e4-8f35-4671-a16a-49553fac40f8 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:51 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-68e177e4-8f35-4671-a16a-49553fac40f8 Jul 06 12:16:51 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:52 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-68e177e4-8f35-4671-a16a-49553fac40f8" returned: 0 in 0.709s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.184s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1937889787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb63968-c035-446f-b64c-593632a514a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014f3e353a7d4ceeb9697be7b9e7cfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:48Z,use_quota=True,user_id='a29bcea49b30452e919e29e7433d123c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Creating volume 0bb63968-c035-446f-b64c-593632a514a7 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:52 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0bb63968-c035-446f-b64c-593632a514a7 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58417402-6467-4b9c-bea9-9c938cae5136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68e177e4-8f35-4671-a16a-49553fac40f8', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabafe84-4426-4ac8-b0f6-d8d205e114e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:52 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0bb63968-c035-446f-b64c-593632a514a7 1073741824 Jul 06 12:16:52 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:52 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Volume volume-68e177e4-8f35-4671-a16a-49553fac40f8 (68e177e4-8f35-4671-a16a-49553fac40f8): created successfully Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabafe84-4426-4ac8-b0f6-d8d205e114e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Flow 'volume_create_manager' (5819fea1-9739-4692-83f2-c063ce2d467d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:52 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b864c0a5-9f67-4a1a-83d5-c78af9d7efdd tempest-CreateVolumesFromImageTest-97382494 None] Created volume successfully. Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:52 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:16:52 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:53 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0bb63968-c035-446f-b64c-593632a514a7 1073741824" returned: 0 in 0.960s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:53 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=95,cinder:SELECT=85,cinder:INSERT=29,cinder:DELETE=7 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:16:53 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.803s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0bb63968-c035-446f-b64c-593632a514a7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:16:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:16:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:16:53 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0bb63968-c035-446f-b64c-593632a514a7 Jul 06 12:16:53 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Acquiring lock "cinder-cd974edd-10e4-4f53-94f1-2b5a10ec01c2-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Lock "cinder-cd974edd-10e4-4f53-94f1-2b5a10ec01c2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Acquiring lock "cinder-quobyte-cd974edd-10e4-4f53-94f1-2b5a10ec01c2" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Lock "cinder-quobyte-cd974edd-10e4-4f53-94f1-2b5a10ec01c2" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13ca485-974b-46a5-9c3a-26b8deff552a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:54 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0bb63968-c035-446f-b64c-593632a514a7" returned: 0 in 0.849s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.453s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-28340645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fb933c-cbc6-44e5-83c3-0dbc00fde2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f5e65222cc48148b8928e58ae0c0c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:48Z,use_quota=True,user_id='53b93f2057aa491c8e37175b3573e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Creating volume 46fb933c-cbc6-44e5-83c3-0dbc00fde2e3 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:54 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:54 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3 1073741824 Jul 06 12:16:54 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c7523d-1147-4a73-b796-9fecd34aaa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb63968-c035-446f-b64c-593632a514a7', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab424d1-5d6f-4899-aca9-9ac9ed904562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:54 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Volume volume-0bb63968-c035-446f-b64c-593632a514a7 (0bb63968-c035-446f-b64c-593632a514a7): created successfully Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab424d1-5d6f-4899-aca9-9ac9ed904562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Flow 'volume_create_manager' (2b5fb37c-169b-4c5f-997f-9520075a2929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:54 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2 Jul 06 12:16:54 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:54 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0128b069-47b1-444e-a4d9-d0f2bb4ca014 tempest-CreateVolumesFromImageTest-97382494 None] Created volume successfully. Jul 06 12:16:55 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2" returned: 0 in 0.933s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:55 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2 Jul 06 12:16:55 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:55 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3 1073741824" returned: 0 in 0.990s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:55 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3 Jul 06 12:16:55 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:55 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-cd974edd-10e4-4f53-94f1-2b5a10ec01c2" returned: 0 in 0.696s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Lock "cinder-quobyte-cd974edd-10e4-4f53-94f1-2b5a10ec01c2" released by "delete_volume" :: held 1.702s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Created reservations ['ed703428-2f13-40f8-876e-ce2db225ad12', 'f14f25e8-29e2-4e15-bb82-6c52b382469e', 'e79ea740-99e1-4895-9444-77982bc1430a', 'b8c1f83c-7a2f-4a00-9a7d-5cf0a50bf411'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:55 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3" returned: 0 in 0.700s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.046s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2002204787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479ad109-9747-4dbb-80f2-0012de826edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014f3e353a7d4ceeb9697be7b9e7cfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:49Z,use_quota=True,user_id='a29bcea49b30452e919e29e7433d123c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Creating volume 479ad109-9747-4dbb-80f2-0012de826edb {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:55 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-479ad109-9747-4dbb-80f2-0012de826edb 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d89ff981-d21e-4bde-880f-3821c4f7fee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:55 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-479ad109-9747-4dbb-80f2-0012de826edb 1073741824 Jul 06 12:16:55 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2320d511-60a5-4938-8b54-5e9f6d0fc9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:56 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Volume volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3 (46fb933c-cbc6-44e5-83c3-0dbc00fde2e3): created successfully Jul 06 12:16:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2320d511-60a5-4938-8b54-5e9f6d0fc9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Flow 'volume_create_manager' (338a8d1b-dafd-4ed1-9a10-7600796119b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:56 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-78239b01-822e-4771-a8e5-25f992d991f2 tempest-AttachVolumeTestJSON-2137043288 None] Created volume successfully. Jul 06 12:16:56 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:16:56 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:56 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.794s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:56 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:56 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Deleted volume successfully. Jul 06 12:16:56 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1a64dc36-dce7-4772-833c-bbcbebd84f3a tempest-VolumesNegativeTest-1846396330 None] Lock "cinder-cd974edd-10e4-4f53-94f1-2b5a10ec01c2-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:56 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-479ad109-9747-4dbb-80f2-0012de826edb 1073741824" returned: 0 in 1.004s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-479ad109-9747-4dbb-80f2-0012de826edb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:57 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-479ad109-9747-4dbb-80f2-0012de826edb Jul 06 12:16:57 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:57 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-479ad109-9747-4dbb-80f2-0012de826edb" returned: 0 in 0.878s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.396s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1916448933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2a5af4c4a8488ab0a1c1cbc3b34cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:49Z,use_quota=True,user_id='188f8ec2f597437ebf8f001aab0e3c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Creating volume a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:57 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:57 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf 1073741824 Jul 06 12:16:57 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828005c0-8f9b-44f3-960c-80fa287f6406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-479ad109-9747-4dbb-80f2-0012de826edb', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59d588e-7a59-4c21-bda3-869d1460b419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:57 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Volume volume-479ad109-9747-4dbb-80f2-0012de826edb (479ad109-9747-4dbb-80f2-0012de826edb): created successfully Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59d588e-7a59-4c21-bda3-869d1460b419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Flow 'volume_create_manager' (f4727c1a-e19e-4e5d-98c2-6efa7020d1ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:57 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c6addcb4-55fb-49e4-8d20-54c3a9256eaa tempest-CreateVolumesFromImageTest-97382494 None] Created volume successfully. Jul 06 12:16:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "cinder-479ad109-9747-4dbb-80f2-0012de826edb-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-479ad109-9747-4dbb-80f2-0012de826edb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "cinder-quobyte-479ad109-9747-4dbb-80f2-0012de826edb" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-quobyte-479ad109-9747-4dbb-80f2-0012de826edb" acquired by "delete_volume" :: waited 0.036s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9232acd5-261c-4d9b-8482-64692caf9000]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-479ad109-9747-4dbb-80f2-0012de826edb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:58 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-479ad109-9747-4dbb-80f2-0012de826edb Jul 06 12:16:58 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:58 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf 1073741824" returned: 0 in 1.089s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:59 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf Jul 06 12:16:59 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:59 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-479ad109-9747-4dbb-80f2-0012de826edb" returned: 0 in 0.937s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-479ad109-9747-4dbb-80f2-0012de826edb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:59 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-479ad109-9747-4dbb-80f2-0012de826edb Jul 06 12:16:59 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:59 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf" returned: 0 in 0.917s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11611d79-e61d-4df4-a7d4-f4d87c829afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9facb40-fc0b-47d4-9ec1-a7b7e3112837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:00 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Volume volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf (a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf): created successfully Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9facb40-fc0b-47d4-9ec1-a7b7e3112837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Flow 'volume_create_manager' (025c0430-a9ca-4ea9-a95a-d1d2191ff531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:00 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-96515c7c-5de6-44d8-9f9f-9c2fc7f21ba0 req-2343ba37-d6a4-43ec-8ade-0756fc92103a tempest-VolumesSnapshotsTestJSON-830767371 None] Created volume successfully. Jul 06 12:17:00 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-67e78b31-3162-4ec0-bfb3-f8f590050376 req-adf2ed3b-b8cd-4137-9b1f-ba1d9c42fc69 tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-67e78b31-3162-4ec0-bfb3-f8f590050376 req-adf2ed3b-b8cd-4137-9b1f-ba1d9c42fc69 tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-479ad109-9747-4dbb-80f2-0012de826edb" returned: 0 in 0.878s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[83154669-ea71-48fc-ae75-307ccdd225c2]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-67e78b31-3162-4ec0-bfb3-f8f590050376 req-adf2ed3b-b8cd-4137-9b1f-ba1d9c42fc69 tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-quobyte-479ad109-9747-4dbb-80f2-0012de826edb" released by "delete_volume" :: held 1.870s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Created reservations ['31e05dbb-035f-4d34-a233-0228110e1065', '55ee7d9d-63da-426b-b038-2e1b93191fbd', '85a5393e-14fc-42fa-ade9-62ea731eaf47', '85e73426-e9d0-477b-9544-7d3be20fab60'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:00 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3 Jul 06 12:17:00 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:00 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:00 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "cinder-0bb63968-c035-446f-b64c-593632a514a7-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-0bb63968-c035-446f-b64c-593632a514a7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "cinder-quobyte-0bb63968-c035-446f-b64c-593632a514a7" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-quobyte-0bb63968-c035-446f-b64c-593632a514a7" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[24391455-dd58-45ef-8643-354daa03aa9e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0bb63968-c035-446f-b64c-593632a514a7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:01 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0bb63968-c035-446f-b64c-593632a514a7 Jul 06 12:17:01 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:01 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-67e78b31-3162-4ec0-bfb3-f8f590050376 req-adf2ed3b-b8cd-4137-9b1f-ba1d9c42fc69 tempest-AttachVolumeTestJSON-2137043288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3" returned: 0 in 1.139s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-67e78b31-3162-4ec0-bfb3-f8f590050376 req-adf2ed3b-b8cd-4137-9b1f-ba1d9c42fc69 tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.160s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.543s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] Creating offline snapshot 1eca7f72-2f21-48b6-9f09-5ab717cb478d of volume a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c115a2-f7ab-4820-be03-e50042e41193]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-67e78b31-3162-4ec0-bfb3-f8f590050376 req-adf2ed3b-b8cd-4137-9b1f-ba1d9c42fc69 tempest-AttachVolumeTestJSON-2137043288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f6f7ffc-9356-4915-aa0a-93954871b3e4', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:17:01 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.024s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:01 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Deleted volume successfully. Jul 06 12:17:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d14f142d-62ef-4a94-ade2-798bfcf4bc82 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-479ad109-9747-4dbb-80f2-0012de826edb-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:01 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-67e78b31-3162-4ec0-bfb3-f8f590050376 req-adf2ed3b-b8cd-4137-9b1f-ba1d9c42fc69 tempest-AttachVolumeTestJSON-2137043288 None] attachment_update completed successfully. Jul 06 12:17:01 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf Jul 06 12:17:01 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:02 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0bb63968-c035-446f-b64c-593632a514a7" returned: 0 in 0.982s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0bb63968-c035-446f-b64c-593632a514a7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:02 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0bb63968-c035-446f-b64c-593632a514a7 Jul 06 12:17:02 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:02 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf" returned: 0 in 0.934s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:02 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d 1G Jul 06 12:17:02 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:03 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0bb63968-c035-446f-b64c-593632a514a7" returned: 0 in 0.834s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-quobyte-0bb63968-c035-446f-b64c-593632a514a7" released by "delete_volume" :: held 1.907s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Created reservations ['ab08761c-2dfa-4216-967e-73533b9cacf5', 'cdfc9152-df19-4b59-9bcc-8ca6d0462726', '6b1b465a-dfef-4289-90bc-e281567ee451', '4d0ae912-2688-41e0-b6f4-3b5ad65c91e7'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:03 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:03 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "cinder-68e177e4-8f35-4671-a16a-49553fac40f8-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-68e177e4-8f35-4671-a16a-49553fac40f8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "cinder-quobyte-68e177e4-8f35-4671-a16a-49553fac40f8" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-quobyte-68e177e4-8f35-4671-a16a-49553fac40f8" acquired by "delete_volume" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1597528e-66c5-4022-94d6-bdc9dc3a7951]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-68e177e4-8f35-4671-a16a-49553fac40f8 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:03 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d 1G" returned: 0 in 1.150s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:03 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d Jul 06 12:17:03 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:03 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-68e177e4-8f35-4671-a16a-49553fac40f8 Jul 06 12:17:03 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:04 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.047s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:04 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:04 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Deleted volume successfully. Jul 06 12:17:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7d13515f-9274-470b-9028-19682eea3380 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-0bb63968-c035-446f-b64c-593632a514a7-delete_volume" released by "delete_volume" :: held 3.266s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:04 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-68e177e4-8f35-4671-a16a-49553fac40f8" returned: 0 in 0.998s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-68e177e4-8f35-4671-a16a-49553fac40f8 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:04 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-68e177e4-8f35-4671-a16a-49553fac40f8 Jul 06 12:17:04 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:04 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d" returned: 0 in 1.078s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:04 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d is being set with open permissions: ugo+rw Jul 06 12:17:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:04 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d Jul 06 12:17:04 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:05 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-68e177e4-8f35-4671-a16a-49553fac40f8" returned: 0 in 0.803s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-quobyte-68e177e4-8f35-4671-a16a-49553fac40f8" released by "delete_volume" :: held 1.876s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:05 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d" returned: 0 in 0.777s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:05 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Created reservations ['f67e0679-1416-4ea8-b981-aba299da32c5', '707a291e-ff31-4d64-b9d1-c7b091bf7448', '4a582b14-1a96-4418-ac2a-b9e01c3330b3', '82d94534-3d8f-4bbd-b5d2-4653d8ed659b'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:05 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.info Jul 06 12:17:05 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:05 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:05 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "cinder-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "cinder-quobyte-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-quobyte-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0" acquired by "delete_volume" :: waited 0.040s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:06 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0993e4a8-0edb-46ee-a8af-72b8ff866d70]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:06 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0 Jul 06 12:17:06 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:06 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.info" returned: 0 in 1.197s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:06 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.info is being set with open permissions: ugo+rw Jul 06 12:17:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:06 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.info Jul 06 12:17:06 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:06 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.095s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:06 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:06 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Deleted volume successfully. Jul 06 12:17:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3f7493ec-b044-42b4-b3b1-2054336300e1 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-68e177e4-8f35-4671-a16a-49553fac40f8-delete_volume" released by "delete_volume" :: held 3.459s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:07 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0" returned: 0 in 1.105s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:07 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0 Jul 06 12:17:07 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:07 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.info" returned: 0 in 0.940s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.270s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:07 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-51142179-3ece-4efa-a567-9886fde8fb0d req-0f2e8446-872c-4932-be9e-9cf25a292927 tempest-AttachVolumeTestJSON-2137043288 None] Terminate volume connection completed successfully. Jul 06 12:17:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-51142179-3ece-4efa-a567-9886fde8fb0d req-0f2e8446-872c-4932-be9e-9cf25a292927 tempest-AttachVolumeTestJSON-2137043288 None] Deleting attachment 82835058-b910-4865-86ed-9460b19ee2dd. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:17:07 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-d1f7424d-35e1-486e-b0bf-7ae5d286731b req-eb29c723-38ba-4e58-833f-dd4785dd328e tempest-VolumesSnapshotsTestJSON-830767371 None] Create snapshot completed successfully Jul 06 12:17:08 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0" returned: 0 in 0.846s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-quobyte-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0" released by "delete_volume" :: held 2.028s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Created reservations ['a568fc0d-11c2-43a1-9c85-bb3d8b0fe9bd', 'a97d7306-caa8-4aee-a89d-833d8942bb34', 'f133319a-56e8-4b90-8f71-0031e56fea97', '80f957db-5eca-4048-ac23-6607e15bb916'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:08 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:08 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Acquiring lock "cinder-1eca7f72-2f21-48b6-9f09-5ab717cb478d-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "cinder-1eca7f72-2f21-48b6-9f09-5ab717cb478d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Acquiring lock "cinder-quobyte-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "cinder-quobyte-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Acquiring lock "cinder-quobyte-1eca7f72-2f21-48b6-9f09-5ab717cb478d" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "cinder-quobyte-1eca7f72-2f21-48b6-9f09-5ab717cb478d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Deleting offline snapshot 1eca7f72-2f21-48b6-9f09-5ab717cb478d of volume a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] snapshot_file for this snap is: volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d577b335-942b-4a33-a471-e5653a038fbc]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:08 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d Jul 06 12:17:08 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:09 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.912s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:09 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:09 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Deleted volume successfully. Jul 06 12:17:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b1f70902-8c54-41a0-8387-eec596a33cfb tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-a07826c1-5e1c-4faf-a43b-2a37b8dc69a0-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "cinder-06d8040f-b142-485b-9562-ded21e3cf683-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-06d8040f-b142-485b-9562-ded21e3cf683-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "cinder-quobyte-06d8040f-b142-485b-9562-ded21e3cf683" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-quobyte-06d8040f-b142-485b-9562-ded21e3cf683" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:09 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7924faf1-fdc6-4252-99f1-2bd89c785822]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-06d8040f-b142-485b-9562-ded21e3cf683 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:09 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:09 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-06d8040f-b142-485b-9562-ded21e3cf683 Jul 06 12:17:09 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d" returned: 0 in 1.080s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:17:09 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a3a860-e978-4bfd-a74d-b1f5db2d8a93]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:09 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf Jul 06 12:17:09 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:10 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-06d8040f-b142-485b-9562-ded21e3cf683" returned: 0 in 0.983s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-06d8040f-b142-485b-9562-ded21e3cf683 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:10 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-b6adc28e-6271-42b8-acb4-7d0457b028c1 req-92cc6cb3-c88a-4a0e-af34-0cad57a7f555 tempest-AttachVolumeTestJSON-2137043288 None] Terminate volume connection completed successfully. Jul 06 12:17:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-b6adc28e-6271-42b8-acb4-7d0457b028c1 req-92cc6cb3-c88a-4a0e-af34-0cad57a7f555 tempest-AttachVolumeTestJSON-2137043288 None] Deleting attachment 1f6f7ffc-9356-4915-aa0a-93954871b3e4. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:17:10 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-06d8040f-b142-485b-9562-ded21e3cf683 Jul 06 12:17:10 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:10 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf" returned: 0 in 1.065s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:10 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d Jul 06 12:17:10 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:11 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-06d8040f-b142-485b-9562-ded21e3cf683" returned: 0 in 0.713s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-quobyte-06d8040f-b142-485b-9562-ded21e3cf683" released by "delete_volume" :: held 1.745s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:11 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Created reservations ['d0b8fa41-a4f0-479e-80b9-9e7575ed6a3e', '90d88568-5e37-48fe-8d6b-acb753c5f4da', 'edd4ecc6-1481-42f3-8ebe-b562d466c999', '2d14237a-7760-44ab-908a-f2823ee20568'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:11 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:11 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:11 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:11 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:11 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d" returned: 0 in 0.859s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:11 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d Jul 06 12:17:11 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:12 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.138s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:12 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:12 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Deleted volume successfully. Jul 06 12:17:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0d70ee17-0e6a-49f3-ba67-f543e6ca6773 tempest-CreateVolumesFromImageTest-97382494 None] Lock "cinder-06d8040f-b142-485b-9562-ded21e3cf683-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf.1eca7f72-2f21-48b6-9f09-5ab717cb478d" returned: 0 in 1.333s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:12 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "cinder-quobyte-1eca7f72-2f21-48b6-9f09-5ab717cb478d" released by "_delete_snapshot" :: held 4.522s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "cinder-quobyte-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf" released by "delete_snapshot" :: held 4.553s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:13 devstack cinder-volume[86761]: DEBUG cinder.quota [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Created reservations ['81d64e83-a289-4538-b921-3bd8aeac3636', '72c49b58-df73-4a62-b165-bc48a2352820', 'f17641fb-b932-4e22-bbb2-1f66a5ba8c01', '2ba01f19-80da-4a91-bb32-41a7825ba24d'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:13 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Delete snapshot completed successfully. Jul 06 12:17:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-2c30d155-6f03-4f6a-9689-03efe479768e req-0eaee9c5-e9c7-4ae1-b460-bf0cdbaad908 tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "cinder-1eca7f72-2f21-48b6-9f09-5ab717cb478d-delete_snapshot" released by "delete_snapshot" :: held 4.843s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:14 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Acquiring lock "cinder-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:14 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "cinder-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:14 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Acquiring lock "cinder-quobyte-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:14 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "cinder-quobyte-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf" acquired by "delete_volume" :: waited 0.035s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:14 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2979d8-ac4e-405a-aa7d-2d4f131232ea]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:14 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf Jul 06 12:17:14 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:15 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf" returned: 0 in 1.302s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:15 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf Jul 06 12:17:15 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:16 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf" returned: 0 in 0.959s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "cinder-quobyte-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf" released by "delete_volume" :: held 2.403s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:16 devstack cinder-volume[86761]: DEBUG cinder.quota [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Created reservations ['6e5622d7-3f3d-4b85-a67b-08536ec38e4b', '0af440b7-3878-4ad9-9201-94971b0c9a80', '4ab50296-c193-486c-a660-99c9a8689c6f', '4cb47711-d573-48f8-a46c-e98b1ac624d4'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:16 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:16 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:17 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.079s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:17 devstack cinder-volume[86761]: DEBUG cinder.manager [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:17 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Deleted volume successfully. Jul 06 12:17:17 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-f1451428-b165-4f5e-a307-91d47149fafa req-6aec6358-29a9-4526-9497-4b4237560301 tempest-VolumesSnapshotsTestJSON-830767371 None] Lock "cinder-a7c2b3ed-5f3e-481a-ac7a-c1106a556cbf-delete_volume" released by "delete_volume" :: held 3.821s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Flow 'volume_create_manager' (c2ea7fbf-e9bc-49b7-a6a2-1f021a101a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b92bdf-0826-468a-838b-7297fae32dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b92bdf-0826-468a-838b-7297fae32dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1925053355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27329531-b51c-4047-ad3d-84819474fa83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e678a1752fd4a888f3c6bbb6df4cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:18Z,use_quota=True,user_id='6b115c3a01654bf7a4a274cd34a32564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133b5b95-6fba-4bcf-837d-dd1734a58aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133b5b95-6fba-4bcf-837d-dd1734a58aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffb871f-2092-4d8d-96a5-918ac91def88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffb871f-2092-4d8d-96a5-918ac91def88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27329531-b51c-4047-ad3d-84819474fa83', 'volume_name': 'volume-27329531-b51c-4047-ad3d-84819474fa83', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6316d7e6-2561-4969-97cb-9893ff017cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6316d7e6-2561-4969-97cb-9893ff017cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a126351-b172-490e-8370-4c3ab2811a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:18 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume 27329531-b51c-4047-ad3d-84819474fa83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27329531-b51c-4047-ad3d-84819474fa83', 'volume_size': 1} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1925053355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27329531-b51c-4047-ad3d-84819474fa83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e678a1752fd4a888f3c6bbb6df4cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:18Z,use_quota=True,user_id='6b115c3a01654bf7a4a274cd34a32564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Creating volume 27329531-b51c-4047-ad3d-84819474fa83 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:18 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:17:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:18 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83 1073741824 Jul 06 12:17:18 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:19 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83 1073741824" returned: 0 in 1.136s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:19 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83 Jul 06 12:17:19 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:20 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83" returned: 0 in 0.918s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] <== create_volume: return (2144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.150s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a126351-b172-490e-8370-4c3ab2811a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27329531-b51c-4047-ad3d-84819474fa83', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155983ea-c4f5-42c5-b2ff-a810e161ba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:20 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume volume-27329531-b51c-4047-ad3d-84819474fa83 (27329531-b51c-4047-ad3d-84819474fa83): created successfully Jul 06 12:17:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155983ea-c4f5-42c5-b2ff-a810e161ba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Flow 'volume_create_manager' (c2ea7fbf-e9bc-49b7-a6a2-1f021a101a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:20 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-1f7d146a-afd2-4c74-98ac-e92f08d452ea tempest-CreateVolumesFromSnapshotTest-463165396 None] Created volume successfully. Jul 06 12:17:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] Creating offline snapshot 401dfe9e-9eab-4880-b140-d067abf45e49 of volume 27329531-b51c-4047-ad3d-84819474fa83 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:17:21 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14bffc9-e589-48f6-be78-f95a4334d630]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:21 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83 Jul 06 12:17:21 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:22 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83" returned: 0 in 0.995s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:22 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49 1G Jul 06 12:17:22 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:23 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "cinder-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:23 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Lock "cinder-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:23 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "cinder-quobyte-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:23 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Lock "cinder-quobyte-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3" acquired by "delete_volume" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:23 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fde7bc-4a74-494c-8482-7dbd9f6452ee]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:23 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49 1G" returned: 0 in 1.277s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27329531-b51c-4047-ad3d-84819474fa83 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:23 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3 Jul 06 12:17:23 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:23 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27329531-b51c-4047-ad3d-84819474fa83 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49 Jul 06 12:17:23 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:24 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3" returned: 0 in 1.014s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:24 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3 Jul 06 12:17:24 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:24 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27329531-b51c-4047-ad3d-84819474fa83 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49" returned: 0 in 1.173s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:24 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49 is being set with open permissions: ugo+rw Jul 06 12:17:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:25 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49 Jul 06 12:17:25 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:25 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3" returned: 0 in 1.019s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:25 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Lock "cinder-quobyte-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3" released by "delete_volume" :: held 2.094s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:25 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Created reservations ['86f2eda5-499d-487f-96f0-7f61ca47838f', '540049bb-7619-4212-b5c4-fadc30139b94', '3351a15d-70f0-4b5d-9fda-ecc2a30a121b', '69593c4c-2414-438d-8f18-e0dd7f9d67f4'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:26 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49" returned: 0 in 1.052s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:26 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:26 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:26 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.info Jul 06 12:17:26 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:27 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.info" returned: 0 in 0.958s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:27 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.info is being set with open permissions: ugo+rw Jul 06 12:17:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "cinder-0cf52848-5833-48ff-a625-36d1b543036a-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:27 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.info Jul 06 12:17:27 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Lock "cinder-0cf52848-5833-48ff-a625-36d1b543036a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:27 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.182s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:27 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:27 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Deleted volume successfully. Jul 06 12:17:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "cinder-quobyte-0cf52848-5833-48ff-a625-36d1b543036a" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Lock "cinder-quobyte-0cf52848-5833-48ff-a625-36d1b543036a" acquired by "delete_volume" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a56a8a23-e535-4553-952a-f9501ea556b9 tempest-AttachVolumeTestJSON-2137043288 None] Lock "cinder-46fb933c-cbc6-44e5-83c3-0dbc00fde2e3-delete_volume" released by "delete_volume" :: held 3.709s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:27 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadc428c-6b0a-4768-b53a-d6a545ec1f19]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0cf52848-5833-48ff-a625-36d1b543036a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:27 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0cf52848-5833-48ff-a625-36d1b543036a Jul 06 12:17:27 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:28 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.info" returned: 0 in 1.062s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.688s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:28 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6c2a3657-8ff2-44c5-9e14-cac24f133658 tempest-CreateVolumesFromSnapshotTest-463165396 None] Create snapshot completed successfully Jul 06 12:17:28 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0cf52848-5833-48ff-a625-36d1b543036a" returned: 0 in 1.197s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0cf52848-5833-48ff-a625-36d1b543036a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:28 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0cf52848-5833-48ff-a625-36d1b543036a Jul 06 12:17:28 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:29 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0cf52848-5833-48ff-a625-36d1b543036a" returned: 0 in 0.969s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Lock "cinder-quobyte-0cf52848-5833-48ff-a625-36d1b543036a" released by "delete_volume" :: held 2.250s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:29 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Created reservations ['325d6b5a-e5f3-40fd-a0ef-59d27212d92c', '6b403b91-7868-4c9b-b28c-5ef6cd77d6c0', 'df8b2173-1285-4e86-be45-ab66ecfb724d', '59c379b9-116e-428b-a8c6-6b932e9f6368'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:29 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:29 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:29 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Flow 'volume_create_manager' (be08a691-551b-43d1-a36f-017bfecc741e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167648ab-e567-4424-bf19-21ee4284b9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167648ab-e567-4424-bf19-21ee4284b9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1024723080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082b5f48-583d-4925-85cf-93510b8cd8a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e678a1752fd4a888f3c6bbb6df4cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:30Z,use_quota=True,user_id='6b115c3a01654bf7a4a274cd34a32564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2d9243-b9c6-459b-8c6e-9a7b1f8329d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2d9243-b9c6-459b-8c6e-9a7b1f8329d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d37e79-246c-4d87-85a8-6b84e6a400c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d37e79-246c-4d87-85a8-6b84e6a400c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082b5f48-583d-4925-85cf-93510b8cd8a9', 'volume_name': 'volume-082b5f48-583d-4925-85cf-93510b8cd8a9', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22585c28-38ac-405a-b748-245657b52fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22585c28-38ac-405a-b748-245657b52fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c58fed7-f0a4-4107-9214-6e660b5e0249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:30 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume 082b5f48-583d-4925-85cf-93510b8cd8a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082b5f48-583d-4925-85cf-93510b8cd8a9', 'volume_size': 1} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1024723080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082b5f48-583d-4925-85cf-93510b8cd8a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e678a1752fd4a888f3c6bbb6df4cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:30Z,use_quota=True,user_id='6b115c3a01654bf7a4a274cd34a32564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Creating volume 082b5f48-583d-4925-85cf-93510b8cd8a9 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:30 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-082b5f48-583d-4925-85cf-93510b8cd8a9 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:30 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-082b5f48-583d-4925-85cf-93510b8cd8a9 1073741824 Jul 06 12:17:30 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "cinder-1d023a32-cd83-4686-acbb-dc471708d793-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Flow 'volume_create_manager' (c1b7910a-1356-4941-b94d-874f1fff9ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852100e5-f673-4e78-b14f-9bebb1fdc62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Lock "cinder-1d023a32-cd83-4686-acbb-dc471708d793-delete_volume" acquired by "delete_volume" :: waited 0.142s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852100e5-f673-4e78-b14f-9bebb1fdc62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1249779563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f419118-7e5b-4629-b85c-861a0e6b2764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e678a1752fd4a888f3c6bbb6df4cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:31Z,use_quota=True,user_id='6b115c3a01654bf7a4a274cd34a32564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee536d00-968a-417b-9c0f-11f72f321bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee536d00-968a-417b-9c0f-11f72f321bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2601f66-7458-4668-bbbb-135264dccb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2601f66-7458-4668-bbbb-135264dccb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f419118-7e5b-4629-b85c-861a0e6b2764', 'volume_name': 'volume-6f419118-7e5b-4629-b85c-861a0e6b2764', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad9aa99-bde8-4334-b4e6-8da4d7fdbca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad9aa99-bde8-4334-b4e6-8da4d7fdbca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438599aa-c97a-451e-a989-a3bed646612b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:31 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume 6f419118-7e5b-4629-b85c-861a0e6b2764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f419118-7e5b-4629-b85c-861a0e6b2764', 'volume_size': 1} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "cinder-quobyte-1d023a32-cd83-4686-acbb-dc471708d793" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Lock "cinder-quobyte-1d023a32-cd83-4686-acbb-dc471708d793" acquired by "delete_volume" :: waited 0.027s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d31c1fb-3830-4154-8924-fe4fbc5194ff]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1d023a32-cd83-4686-acbb-dc471708d793 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:31 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.629s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:31 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Deleted volume successfully. Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-efc6d9da-792b-474b-994f-c4c1e0ebc67c tempest-AttachVolumeTestJSON-2137043288 None] Lock "cinder-0cf52848-5833-48ff-a625-36d1b543036a-delete_volume" released by "delete_volume" :: held 4.405s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:31 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1d023a32-cd83-4686-acbb-dc471708d793 Jul 06 12:17:31 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:31 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-082b5f48-583d-4925-85cf-93510b8cd8a9 1073741824" returned: 0 in 1.873s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-082b5f48-583d-4925-85cf-93510b8cd8a9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:32 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-082b5f48-583d-4925-85cf-93510b8cd8a9 Jul 06 12:17:32 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:32 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Flow 'volume_create_manager' (d43a1506-ef42-4fff-9893-d22a2bdac605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e068ef84-8a4d-45d3-8287-01b4d7f51aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e068ef84-8a4d-45d3-8287-01b4d7f51aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1944482283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b8d804-fa67-4705-9a2d-409b1024f1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e678a1752fd4a888f3c6bbb6df4cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:32Z,use_quota=True,user_id='6b115c3a01654bf7a4a274cd34a32564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6c62fa-fdf7-49bf-97c7-e3e4304d48b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6c62fa-fdf7-49bf-97c7-e3e4304d48b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5917162-b103-43d4-9182-b10ebec824b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5917162-b103-43d4-9182-b10ebec824b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b8d804-fa67-4705-9a2d-409b1024f1b9', 'volume_name': 'volume-72b8d804-fa67-4705-9a2d-409b1024f1b9', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b4b43e-fde6-46ab-8200-a51d217126ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b4b43e-fde6-46ab-8200-a51d217126ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b8b7e9-4efd-4930-a954-5f0ed1f9d6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:32 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume 72b8d804-fa67-4705-9a2d-409b1024f1b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b8d804-fa67-4705-9a2d-409b1024f1b9', 'volume_size': 1} Jul 06 12:17:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Flow 'volume_create_manager' (861b3678-7f86-464f-a680-020b79b36715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941ef957-bb83-4737-ac47-ffa0a26d79c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941ef957-bb83-4737-ac47-ffa0a26d79c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-624117778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bccd923f-c9cd-4662-8b7d-103ede521ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e678a1752fd4a888f3c6bbb6df4cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:33Z,use_quota=True,user_id='6b115c3a01654bf7a4a274cd34a32564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:33 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c19aeb4-6b12-466a-91aa-da16a2f9f458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c19aeb4-6b12-466a-91aa-da16a2f9f458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a416845b-f280-4cff-9c82-8d8c9a5d1ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a416845b-f280-4cff-9c82-8d8c9a5d1ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bccd923f-c9cd-4662-8b7d-103ede521ece', 'volume_name': 'volume-bccd923f-c9cd-4662-8b7d-103ede521ece', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1395cb4e-2b4f-4e6a-9096-5d9a6b341d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1395cb4e-2b4f-4e6a-9096-5d9a6b341d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abcc1bf7-5f9c-4e28-aa3b-6d3e00b24458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:33 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume bccd923f-c9cd-4662-8b7d-103ede521ece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bccd923f-c9cd-4662-8b7d-103ede521ece', 'volume_size': 1} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1d023a32-cd83-4686-acbb-dc471708d793" returned: 0 in 1.825s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1d023a32-cd83-4686-acbb-dc471708d793 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:33 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1d023a32-cd83-4686-acbb-dc471708d793 Jul 06 12:17:33 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Flow 'volume_create_manager' (626d60f3-349c-4ac7-9d4e-704dccb90967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72820bd-c54d-480f-8dad-a6a8851e6da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72820bd-c54d-480f-8dad-a6a8851e6da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548192257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f2ae17-cc3a-4752-941e-baadfd5ae1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e678a1752fd4a888f3c6bbb6df4cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:33Z,use_quota=True,user_id='6b115c3a01654bf7a4a274cd34a32564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07375da5-eb1a-4171-bac5-9c652aa1de1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07375da5-eb1a-4171-bac5-9c652aa1de1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629db14c-0a4b-4d32-8246-da74750f4e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629db14c-0a4b-4d32-8246-da74750f4e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f2ae17-cc3a-4752-941e-baadfd5ae1d5', 'volume_name': 'volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383bd77a-2eca-4a8a-82d7-dc67f7a7437a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383bd77a-2eca-4a8a-82d7-dc67f7a7437a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dedeec11-7af0-4eeb-af29-3fd723f08e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:33 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume d0f2ae17-cc3a-4752-941e-baadfd5ae1d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5', 'volume_size': 1} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:33 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-082b5f48-583d-4925-85cf-93510b8cd8a9" returned: 0 in 1.693s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] <== create_volume: return (3704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.708s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.519s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1249779563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f419118-7e5b-4629-b85c-861a0e6b2764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e678a1752fd4a888f3c6bbb6df4cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:31Z,use_quota=True,user_id='6b115c3a01654bf7a4a274cd34a32564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Creating volume 6f419118-7e5b-4629-b85c-861a0e6b2764 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:33 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6f419118-7e5b-4629-b85c-861a0e6b2764 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:33 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6f419118-7e5b-4629-b85c-861a0e6b2764 1073741824 Jul 06 12:17:33 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c58fed7-f0a4-4107-9214-6e660b5e0249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082b5f48-583d-4925-85cf-93510b8cd8a9', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5960e3-f38f-473e-96e7-68aaaf28d72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:33 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume volume-082b5f48-583d-4925-85cf-93510b8cd8a9 (082b5f48-583d-4925-85cf-93510b8cd8a9): created successfully Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5960e3-f38f-473e-96e7-68aaaf28d72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Flow 'volume_create_manager' (be08a691-551b-43d1-a36f-017bfecc741e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:33 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6f2843b2-bbe3-47b5-9d30-907bb90fa3a4 tempest-CreateVolumesFromSnapshotTest-463165396 None] Created volume successfully. Jul 06 12:17:34 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1d023a32-cd83-4686-acbb-dc471708d793" returned: 0 in 1.016s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Lock "cinder-quobyte-1d023a32-cd83-4686-acbb-dc471708d793" released by "delete_volume" :: held 2.921s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:34 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Created reservations ['91ef445a-780f-4b8d-99d3-7ecf63f08b04', 'e2512116-db75-4a44-a1f1-12f006c1ea2a', 'e58bab09-8094-416e-bfa0-b7e4914fa20a', '999ef13c-6bde-403b-bbd8-24fdd26e7f0c'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:34 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:34 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:34 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:34 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:35 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6f419118-7e5b-4629-b85c-861a0e6b2764 1073741824" returned: 0 in 1.729s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6f419118-7e5b-4629-b85c-861a0e6b2764 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:35 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6f419118-7e5b-4629-b85c-861a0e6b2764 Jul 06 12:17:35 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:35 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.235s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:35 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:35 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Deleted volume successfully. Jul 06 12:17:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-eea455e0-76c0-4cb6-8c5a-b665d8825540 tempest-AttachVolumeTestJSON-2137043288 None] Lock "cinder-1d023a32-cd83-4686-acbb-dc471708d793-delete_volume" released by "delete_volume" :: held 4.652s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:36 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6f419118-7e5b-4629-b85c-861a0e6b2764" returned: 0 in 0.991s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] <== create_volume: return (2800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.804s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.976s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1944482283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b8d804-fa67-4705-9a2d-409b1024f1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e678a1752fd4a888f3c6bbb6df4cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:32Z,use_quota=True,user_id='6b115c3a01654bf7a4a274cd34a32564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Creating volume 72b8d804-fa67-4705-9a2d-409b1024f1b9 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:36 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72b8d804-fa67-4705-9a2d-409b1024f1b9 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438599aa-c97a-451e-a989-a3bed646612b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f419118-7e5b-4629-b85c-861a0e6b2764', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:36 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72b8d804-fa67-4705-9a2d-409b1024f1b9 1073741824 Jul 06 12:17:36 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c836f5-4aef-4556-bfe1-478238a97d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:36 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume volume-6f419118-7e5b-4629-b85c-861a0e6b2764 (6f419118-7e5b-4629-b85c-861a0e6b2764): created successfully Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c836f5-4aef-4556-bfe1-478238a97d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Flow 'volume_create_manager' (c1b7910a-1356-4941-b94d-874f1fff9ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Flow 'volume_create_manager' (8cf6605c-1eb9-441d-ad24-889175e3701c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b6c26e-7a39-4ce4-87ad-fe2731d023e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b6c26e-7a39-4ce4-87ad-fe2731d023e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1743171485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01822a0a-e750-4ea2-b972-001bd09675ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fb8cebb5d449acac393baab1e07e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:37Z,use_quota=True,user_id='528e9081baa444868c235f7070f0d601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb8ca7b-ce77-4495-b986-125a0e7f51ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb8ca7b-ce77-4495-b986-125a0e7f51ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53860847-0aca-4e6f-85ec-b62db7b1e9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53860847-0aca-4e6f-85ec-b62db7b1e9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01822a0a-e750-4ea2-b972-001bd09675ea', 'volume_name': 'volume-01822a0a-e750-4ea2-b972-001bd09675ea', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc00d252-7d6d-4d6e-a311-32f9bdf3b802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc00d252-7d6d-4d6e-a311-32f9bdf3b802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430c5634-b20f-4052-87d0-353b33e2fb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:36 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Volume 01822a0a-e750-4ea2-b972-001bd09675ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01822a0a-e750-4ea2-b972-001bd09675ea', 'volume_size': 1} Jul 06 12:17:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:36 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-acc5eb2d-d75c-4a44-acd1-a18c9ff73a5b tempest-CreateVolumesFromSnapshotTest-463165396 None] Created volume successfully. Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Flow 'volume_create_manager' (3081fa39-ad81-4eb9-8b51-20fee468d87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:38 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc348a71-ab17-4766-b544-1af157a2ccc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72b8d804-fa67-4705-9a2d-409b1024f1b9 1073741824" returned: 0 in 1.437s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc348a71-ab17-4766-b544-1af157a2ccc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-881575056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9942b97-6a55-4a23-bacc-9cd37c3ad944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e285eabe2fb4b1aad2035f17dffb73a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:38Z,use_quota=True,user_id='6d057f11d7304090b339373ca4016be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b163674-d98d-44f4-b980-61a1d317cc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b163674-d98d-44f4-b980-61a1d317cc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a37642-0156-4698-83f0-92dce02bf63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a37642-0156-4698-83f0-92dce02bf63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9942b97-6a55-4a23-bacc-9cd37c3ad944', 'volume_name': 'volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e071a1a2-a295-45fa-87bf-2086890a0159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e071a1a2-a295-45fa-87bf-2086890a0159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3479d7f9-d126-410e-8e84-37218eb39e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:38 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Volume d9942b97-6a55-4a23-bacc-9cd37c3ad944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944', 'volume_size': 1} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72b8d804-fa67-4705-9a2d-409b1024f1b9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:38 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72b8d804-fa67-4705-9a2d-409b1024f1b9 Jul 06 12:17:38 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:38 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72b8d804-fa67-4705-9a2d-409b1024f1b9" returned: 0 in 0.717s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] <== create_volume: return (2290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.296s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.661s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-624117778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bccd923f-c9cd-4662-8b7d-103ede521ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e678a1752fd4a888f3c6bbb6df4cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:33Z,use_quota=True,user_id='6b115c3a01654bf7a4a274cd34a32564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Creating volume bccd923f-c9cd-4662-8b7d-103ede521ece {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:38 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bccd923f-c9cd-4662-8b7d-103ede521ece 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b8b7e9-4efd-4930-a954-5f0ed1f9d6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b8d804-fa67-4705-9a2d-409b1024f1b9', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0111784-ae5d-4faf-af48-885ed9075dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:38 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bccd923f-c9cd-4662-8b7d-103ede521ece 1073741824 Jul 06 12:17:38 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:38 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume volume-72b8d804-fa67-4705-9a2d-409b1024f1b9 (72b8d804-fa67-4705-9a2d-409b1024f1b9): created successfully Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0111784-ae5d-4faf-af48-885ed9075dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Flow 'volume_create_manager' (d43a1506-ef42-4fff-9893-d22a2bdac605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:38 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d2e9aa06-a87c-4524-9560-92982e2a67d8 tempest-CreateVolumesFromSnapshotTest-463165396 None] Created volume successfully. Jul 06 12:17:40 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bccd923f-c9cd-4662-8b7d-103ede521ece 1073741824" returned: 0 in 1.124s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bccd923f-c9cd-4662-8b7d-103ede521ece {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:40 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bccd923f-c9cd-4662-8b7d-103ede521ece Jul 06 12:17:40 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:40 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bccd923f-c9cd-4662-8b7d-103ede521ece" returned: 0 in 0.866s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.297s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548192257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f2ae17-cc3a-4752-941e-baadfd5ae1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e678a1752fd4a888f3c6bbb6df4cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:33Z,use_quota=True,user_id='6b115c3a01654bf7a4a274cd34a32564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Creating volume d0f2ae17-cc3a-4752-941e-baadfd5ae1d5 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:40 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:17:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abcc1bf7-5f9c-4e28-aa3b-6d3e00b24458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bccd923f-c9cd-4662-8b7d-103ede521ece', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:41 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5 1073741824 Jul 06 12:17:41 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70b47bf-05c4-4710-99db-146e9c831a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:41 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume volume-bccd923f-c9cd-4662-8b7d-103ede521ece (bccd923f-c9cd-4662-8b7d-103ede521ece): created successfully Jul 06 12:17:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70b47bf-05c4-4710-99db-146e9c831a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Flow 'volume_create_manager' (861b3678-7f86-464f-a680-020b79b36715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:41 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-dd90277a-f2a2-40e2-8650-d83fb7927716 tempest-CreateVolumesFromSnapshotTest-463165396 None] Created volume successfully. Jul 06 12:17:42 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5 1073741824" returned: 0 in 1.115s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:42 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5 Jul 06 12:17:42 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:42 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5" returned: 0 in 0.701s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.027s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1743171485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01822a0a-e750-4ea2-b972-001bd09675ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fb8cebb5d449acac393baab1e07e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:37Z,use_quota=True,user_id='528e9081baa444868c235f7070f0d601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Creating volume 01822a0a-e750-4ea2-b972-001bd09675ea {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:42 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dedeec11-7af0-4eeb-af29-3fd723f08e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:42 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea 1073741824 Jul 06 12:17:42 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f14e80-bd19-458d-bfc7-00015b6dd5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:42 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Volume volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5 (d0f2ae17-cc3a-4752-941e-baadfd5ae1d5): created successfully Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f14e80-bd19-458d-bfc7-00015b6dd5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Flow 'volume_create_manager' (626d60f3-349c-4ac7-9d4e-704dccb90967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:42 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f7dc8cca-9fb4-426e-a371-69968908237f tempest-CreateVolumesFromSnapshotTest-463165396 None] Created volume successfully. Jul 06 12:17:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "cinder-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "cinder-quobyte-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:43 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc099ba-1127-4cf4-b6fa-ca87da3db74c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:43 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5 Jul 06 12:17:43 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:44 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea 1073741824" returned: 0 in 1.193s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:44 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea Jul 06 12:17:44 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:44 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5" returned: 0 in 1.091s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:44 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5 Jul 06 12:17:44 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:44 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea" returned: 0 in 0.831s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] <== create_volume: return (2088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.827s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-881575056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9942b97-6a55-4a23-bacc-9cd37c3ad944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e285eabe2fb4b1aad2035f17dffb73a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:38Z,use_quota=True,user_id='6d057f11d7304090b339373ca4016be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Creating volume d9942b97-6a55-4a23-bacc-9cd37c3ad944 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:44 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430c5634-b20f-4052-87d0-353b33e2fb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01822a0a-e750-4ea2-b972-001bd09675ea', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:44 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944 1073741824 Jul 06 12:17:44 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14985fec-0c3d-4564-89b3-642becf5511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:45 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Volume volume-01822a0a-e750-4ea2-b972-001bd09675ea (01822a0a-e750-4ea2-b972-001bd09675ea): created successfully Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14985fec-0c3d-4564-89b3-642becf5511e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Flow 'volume_create_manager' (8cf6605c-1eb9-441d-ad24-889175e3701c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:45 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d908c68e-3c0e-408d-9e08-c31e097ec1d5 tempest-SnapshotDependencyTests-267601800 None] Created volume successfully. Jul 06 12:17:45 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5" returned: 0 in 0.749s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5" released by "delete_volume" :: held 1.899s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Created reservations ['bc84b780-1c9e-4347-a2d7-8043ec225759', 'b53a9570-99ff-4e31-8040-25943d68804e', 'dc0f5bd3-e801-41c9-9a57-839c15071762', 'a4457dab-9709-4143-be09-4be54d00d115'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:45 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:45 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9f8cde6c-6d33-46e8-bc16-e609a16188b3 tempest-BackendsCapabilitiesAdminTestsJSON-717853302 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7533416748047, 'free_capacity_gb': 1775.7533416748047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86761) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "cinder-bccd923f-c9cd-4662-8b7d-103ede521ece-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-bccd923f-c9cd-4662-8b7d-103ede521ece-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "cinder-quobyte-bccd923f-c9cd-4662-8b7d-103ede521ece" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-bccd923f-c9cd-4662-8b7d-103ede521ece" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d38729-40bb-47f2-b14f-b60bc22e8f18]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bccd923f-c9cd-4662-8b7d-103ede521ece {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:46 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bccd923f-c9cd-4662-8b7d-103ede521ece Jul 06 12:17:46 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:46 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944 1073741824" returned: 0 in 1.192s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5b03eb85-3e9c-4498-869d-b64fd288b3d9 tempest-BackendsCapabilitiesAdminTestsJSON-717853302 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7533416748047, 'free_capacity_gb': 1775.7533416748047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86761) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 12:17:46 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944 Jul 06 12:17:46 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:46 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.873s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:46 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:46 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Deleted volume successfully. Jul 06 12:17:46 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6398b0f9-3c85-4add-a523-da9ebd94131a tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-d0f2ae17-cc3a-4752-941e-baadfd5ae1d5-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:46 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bccd923f-c9cd-4662-8b7d-103ede521ece" returned: 0 in 1.042s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bccd923f-c9cd-4662-8b7d-103ede521ece {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:47 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bccd923f-c9cd-4662-8b7d-103ede521ece Jul 06 12:17:47 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:47 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944" returned: 0 in 0.891s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] <== create_volume: return (2163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.401s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3479d7f9-d126-410e-8e84-37218eb39e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c815378-8c68-419a-9a27-e4c98d443c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] Creating offline snapshot 388bd124-0f09-497a-8259-ba0b5e2ddbd9 of volume 01822a0a-e750-4ea2-b972-001bd09675ea {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:17:47 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Volume volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944 (d9942b97-6a55-4a23-bacc-9cd37c3ad944): created successfully Jul 06 12:17:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c815378-8c68-419a-9a27-e4c98d443c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Flow 'volume_create_manager' (3081fa39-ad81-4eb9-8b51-20fee468d87a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:47 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc5d2f6-e5e1-471a-8113-d262258ff542]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:47 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b2978de7-ceb4-4fa9-af6d-4a705feb0d77 tempest-VolumeQuotasAdminTestJSON-561693225 None] Created volume successfully. Jul 06 12:17:47 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea Jul 06 12:17:47 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:47 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bccd923f-c9cd-4662-8b7d-103ede521ece" returned: 0 in 0.879s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-bccd923f-c9cd-4662-8b7d-103ede521ece" released by "delete_volume" :: held 1.977s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:47 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Created reservations ['0428198c-8bef-41a0-a722-19d1a9344a41', 'dbc8d013-60fc-415f-af3f-476f3dbc961b', '976bfb9d-30c2-4f53-b6a7-ddbbe3aed8d5', '1162587e-bc47-49d3-868c-3a24445395b8'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Acquiring lock "cinder-d9942b97-6a55-4a23-bacc-9cd37c3ad944-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:48 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:48 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Lock "cinder-d9942b97-6a55-4a23-bacc-9cd37c3ad944-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "cinder-72b8d804-fa67-4705-9a2d-409b1024f1b9-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-72b8d804-fa67-4705-9a2d-409b1024f1b9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Acquiring lock "cinder-quobyte-d9942b97-6a55-4a23-bacc-9cd37c3ad944" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "cinder-quobyte-72b8d804-fa67-4705-9a2d-409b1024f1b9" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Lock "cinder-quobyte-d9942b97-6a55-4a23-bacc-9cd37c3ad944" acquired by "delete_volume" :: waited 0.039s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:48 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea" returned: 0 in 1.132s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-72b8d804-fa67-4705-9a2d-409b1024f1b9" acquired by "delete_volume" :: waited 0.043s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adf0b1f-a7bf-489e-898f-24b6d3ff9ce0]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:48 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 1G Jul 06 12:17:48 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ec91a6-0f95-41d5-aef2-13874c7de261]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72b8d804-fa67-4705-9a2d-409b1024f1b9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:48 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944 Jul 06 12:17:48 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:48 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72b8d804-fa67-4705-9a2d-409b1024f1b9 Jul 06 12:17:48 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:49 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.156s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:49 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:49 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Deleted volume successfully. Jul 06 12:17:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-981b6e19-a0c6-4b32-871d-8425aa132827 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-bccd923f-c9cd-4662-8b7d-103ede521ece-delete_volume" released by "delete_volume" :: held 3.448s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:49 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944" returned: 0 in 1.074s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:49 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944 Jul 06 12:17:49 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:49 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72b8d804-fa67-4705-9a2d-409b1024f1b9" returned: 0 in 1.163s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72b8d804-fa67-4705-9a2d-409b1024f1b9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:49 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72b8d804-fa67-4705-9a2d-409b1024f1b9 Jul 06 12:17:49 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:49 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 1G" returned: 0 in 1.393s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01822a0a-e750-4ea2-b972-001bd09675ea -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:49 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01822a0a-e750-4ea2-b972-001bd09675ea -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 Jul 06 12:17:49 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:50 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:50 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9942b97-6a55-4a23-bacc-9cd37c3ad944" returned: 0 in 1.126s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72b8d804-fa67-4705-9a2d-409b1024f1b9" returned: 0 in 1.029s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Lock "cinder-quobyte-d9942b97-6a55-4a23-bacc-9cd37c3ad944" released by "delete_volume" :: held 2.280s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-72b8d804-fa67-4705-9a2d-409b1024f1b9" released by "delete_volume" :: held 2.254s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:INSERT=39,cinder:UPDATE=138,cinder:SELECT=103,cinder:DELETE=18 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Created reservations ['496a93f9-7592-48d2-bb8a-58e8bad14800', '64ebb6bb-9879-4352-81e5-9e00c55c77fb', '85caed59-63bf-4393-bda9-ab167f918830', 'bb3d7e70-d6bd-4b47-b8b4-883703af40ef'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Created reservations ['b654701d-e15c-4884-b41b-411d3214b31b', 'c6c55c9b-f169-4709-adea-5b7eaa7be62b', '4cb80b8d-8a03-49ac-82a8-1c374d0a0494', '59071dc9-8ceb-4676-85f1-1ab31bfcf230'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:50 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01822a0a-e750-4ea2-b972-001bd09675ea -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9" returned: 0 in 1.001s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:50 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 is being set with open permissions: ugo+rw Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:50 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 Jul 06 12:17:50 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:50 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:50 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:50 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:50 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:51 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "cinder-6f419118-7e5b-4629-b85c-861a0e6b2764-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9" returned: 0 in 1.018s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:51 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.945s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:51 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-6f419118-7e5b-4629-b85c-861a0e6b2764-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Deleted volume successfully. Jul 06 12:17:51 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.116s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:51 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Deleted volume successfully. Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "cinder-quobyte-6f419118-7e5b-4629-b85c-861a0e6b2764" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:52 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.info Jul 06 12:17:52 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4a6aebf3-cde5-4f23-9aef-5230dccfc943 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-72b8d804-fa67-4705-9a2d-409b1024f1b9-delete_volume" released by "delete_volume" :: held 3.844s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-6f419118-7e5b-4629-b85c-861a0e6b2764" acquired by "delete_volume" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7aae7bbe-a97f-4fb9-beb5-130f68a9bdbf tempest-VolumeQuotasAdminTestJSON-561693225 None] Lock "cinder-d9942b97-6a55-4a23-bacc-9cd37c3ad944-delete_volume" released by "delete_volume" :: held 3.984s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edfbe43-5057-4e70-b56d-6774e3b10486]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6f419118-7e5b-4629-b85c-861a0e6b2764 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:52 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6f419118-7e5b-4629-b85c-861a0e6b2764 Jul 06 12:17:52 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:52 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:52 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Flow 'volume_create_manager' (bf3a02e7-4636-42d6-afad-b94724662922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556e2483-a581-4283-8ba0-59f837daad47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556e2483-a581-4283-8ba0-59f837daad47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-544533630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3ad839-0292-4208-9168-c0235bb633a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e285eabe2fb4b1aad2035f17dffb73a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:52Z,use_quota=True,user_id='6d057f11d7304090b339373ca4016be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039503e2-5f09-483e-bf19-ba90b343139c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039503e2-5f09-483e-bf19-ba90b343139c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80788c2-1df8-489f-ae66-4a18824f8453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80788c2-1df8-489f-ae66-4a18824f8453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb3ad839-0292-4208-9168-c0235bb633a2', 'volume_name': 'volume-eb3ad839-0292-4208-9168-c0235bb633a2', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292f6a8b-ac59-433b-9d08-699f1eff9f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292f6a8b-ac59-433b-9d08-699f1eff9f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d34a88-6bb3-48df-8c72-165aa181e984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:52 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Volume eb3ad839-0292-4208-9168-c0235bb633a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb3ad839-0292-4208-9168-c0235bb633a2', 'volume_size': 1} Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:52 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.info" returned: 0 in 0.901s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:52 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.info is being set with open permissions: ugo+rw Jul 06 12:17:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:52 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.info Jul 06 12:17:52 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:53 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6f419118-7e5b-4629-b85c-861a0e6b2764" returned: 0 in 1.080s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6f419118-7e5b-4629-b85c-861a0e6b2764 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:53 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6f419118-7e5b-4629-b85c-861a0e6b2764 Jul 06 12:17:53 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:53 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.858s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:17:53 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.info" returned: 0 in 0.808s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.642s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.031s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-544533630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3ad839-0292-4208-9168-c0235bb633a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e285eabe2fb4b1aad2035f17dffb73a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:52Z,use_quota=True,user_id='6d057f11d7304090b339373ca4016be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Creating volume eb3ad839-0292-4208-9168-c0235bb633a2 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:53 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-eb3ad839-0292-4208-9168-c0235bb633a2 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:53 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=123,cinder:UPDATE=169,cinder:INSERT=37,cinder:DELETE=9 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:17:53 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-eb3ad839-0292-4208-9168-c0235bb633a2 1073741824 Jul 06 12:17:53 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:53 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-07243a42-f1cd-4a34-bfad-60348acfe62e tempest-SnapshotDependencyTests-267601800 None] Create snapshot completed successfully Jul 06 12:17:54 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f800bc5b-7835-4a2f-a963-df337d6ab2fd tempest-GroupSnapshotsTest-1727086509 None] Group tempest-GroupSnapshotsTest-Group-696812168: creating Jul 06 12:17:54 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6f419118-7e5b-4629-b85c-861a0e6b2764" returned: 0 in 0.873s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-6f419118-7e5b-4629-b85c-861a0e6b2764" released by "delete_volume" :: held 2.022s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:54 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f800bc5b-7835-4a2f-a963-df337d6ab2fd tempest-GroupSnapshotsTest-1727086509 None] Group tempest-GroupSnapshotsTest-Group-696812168: created successfully Jul 06 12:17:54 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f800bc5b-7835-4a2f-a963-df337d6ab2fd tempest-GroupSnapshotsTest-1727086509 None] Create group completed successfully. Jul 06 12:17:54 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Created reservations ['6068edda-e44f-4e2e-b921-2b5d38eaa9af', '6e74b0ee-b918-461d-bee0-5bea87ab7662', '119f90de-a188-42b3-929e-d725f5551570', '2dc9b7d3-8cdc-40ab-9ab6-5ec7baced41c'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:54 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:54 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:54 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-eb3ad839-0292-4208-9168-c0235bb633a2 1073741824" returned: 0 in 1.074s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-eb3ad839-0292-4208-9168-c0235bb633a2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:54 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-eb3ad839-0292-4208-9168-c0235bb633a2 Jul 06 12:17:54 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:55 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.780s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Flow 'volume_create_manager' (5a911f01-ced7-41c0-bf28-a0aad0bd1fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62ef9f4-9c1a-4a35-987f-9f11a6c856af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Deleted volume successfully. Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62ef9f4-9c1a-4a35-987f-9f11a6c856af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71341fec-4271-4652-8590-5d01ef6c43cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fb8cebb5d449acac393baab1e07e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=388bd124-0f09-497a-8259-ba0b5e2ddbd9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:55Z,use_quota=True,user_id='528e9081baa444868c235f7070f0d601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c17b27-b401-432d-b6dc-186b68aa6680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c17b27-b401-432d-b6dc-186b68aa6680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e994f2-a566-4de2-8f48-9812f036ed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e994f2-a566-4de2-8f48-9812f036ed09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '71341fec-4271-4652-8590-5d01ef6c43cc', 'volume_name': 'volume-71341fec-4271-4652-8590-5d01ef6c43cc', 'volume_size': 1, 'snapshot_id': '388bd124-0f09-497a-8259-ba0b5e2ddbd9'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e05648e-41e4-476a-a00a-6728b0c97dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e05648e-41e4-476a-a00a-6728b0c97dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8481a2bb-53aa-4f34-8b26-8868e809be83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Volume 71341fec-4271-4652-8590-5d01ef6c43cc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-71341fec-4271-4652-8590-5d01ef6c43cc', 'volume_size': 1, 'snapshot_id': '388bd124-0f09-497a-8259-ba0b5e2ddbd9'} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58ffb0b6-862a-4684-82fd-ab5a55bcc7ca tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-6f419118-7e5b-4629-b85c-861a0e6b2764-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "cinder-082b5f48-583d-4925-85cf-93510b8cd8a9-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-082b5f48-583d-4925-85cf-93510b8cd8a9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "cinder-quobyte-082b5f48-583d-4925-85cf-93510b8cd8a9" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-082b5f48-583d-4925-85cf-93510b8cd8a9" acquired by "delete_volume" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c454ba-14d7-4ea8-80e1-2d7640580549]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-082b5f48-583d-4925-85cf-93510b8cd8a9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:55 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-082b5f48-583d-4925-85cf-93510b8cd8a9 Jul 06 12:17:55 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:55 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-eb3ad839-0292-4208-9168-c0235bb633a2" returned: 0 in 0.888s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.595s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "cinder-quobyte-388bd124-0f09-497a-8259-ba0b5e2ddbd9-71341fec-4271-4652-8590-5d01ef6c43cc" by "_create_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d34a88-6bb3-48df-8c72-165aa181e984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb3ad839-0292-4208-9168-c0235bb633a2', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664dc660-54c8-4bb6-91b2-089d0c750702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-quobyte-388bd124-0f09-497a-8259-ba0b5e2ddbd9-71341fec-4271-4652-8590-5d01ef6c43cc" acquired by "_create_volume_from_snapshot" :: waited 0.070s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Creating volume 71341fec-4271-4652-8590-5d01ef6c43cc from snapshot 388bd124-0f09-497a-8259-ba0b5e2ddbd9 {{(pid=86761) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "cinder-quobyte-71341fec-4271-4652-8590-5d01ef6c43cc" by "_copy_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Flow 'volume_create_manager' (62324abb-b180-488d-9c2e-0637e1f90967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f236d9-7f93-4440-8fed-1184e38fb52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-quobyte-71341fec-4271-4652-8590-5d01ef6c43cc" acquired by "_copy_volume_from_snapshot" :: waited 0.060s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] snapshot: 388bd124-0f09-497a-8259-ba0b5e2ddbd9, volume: 71341fec-4271-4652-8590-5d01ef6c43cc, {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:17:55 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Volume volume-eb3ad839-0292-4208-9168-c0235bb633a2 (eb3ad839-0292-4208-9168-c0235bb633a2): created successfully Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664dc660-54c8-4bb6-91b2-089d0c750702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Flow 'volume_create_manager' (bf3a02e7-4636-42d6-afad-b94724662922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f236d9-7f93-4440-8fed-1184e38fb52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-379976387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1cbf3f6-7286-4a1e-b3ea-1dab4459acc6,host='devstack@QuobyteHD#QuobyteHD',id=fabc59e4-7c5a-4d13-ab99-afd82965d832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aebfcb21abe34d10a1de3765da086f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:56Z,use_quota=True,user_id='71cdfd826dff47d091093b9cafb88692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e62bd4d-81f7-4aba-96f4-48b6030f4fdc),volume_type_id=6e62bd4d-81f7-4aba-96f4-48b6030f4fdc)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19006fd-70de-40c7-8ad4-a693d4aec428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19006fd-70de-40c7-8ad4-a693d4aec428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbdce8c-6d02-469e-83dc-b0059c59694c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbdce8c-6d02-469e-83dc-b0059c59694c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fabc59e4-7c5a-4d13-ab99-afd82965d832', 'volume_name': 'volume-fabc59e4-7c5a-4d13-ab99-afd82965d832', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97317a4d-05eb-441b-a1db-e7878611705e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97317a4d-05eb-441b-a1db-e7878611705e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f59ff98-5ee6-49ca-94bf-95ef8e06faa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:56 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Volume fabc59e4-7c5a-4d13-ab99-afd82965d832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fabc59e4-7c5a-4d13-ab99-afd82965d832', 'volume_size': 1} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:56 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-052e8d50-53dc-4142-8c1c-8c90a66a65db tempest-VolumeQuotasAdminTestJSON-561693225 None] Created volume successfully. Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eba8ba-df65-4f67-a0d8-4a12f6b088b4]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:56 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 Jul 06 12:17:56 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:56 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-082b5f48-583d-4925-85cf-93510b8cd8a9" returned: 0 in 0.901s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-082b5f48-583d-4925-85cf-93510b8cd8a9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:56 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-082b5f48-583d-4925-85cf-93510b8cd8a9 Jul 06 12:17:56 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:56 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-082b5f48-583d-4925-85cf-93510b8cd8a9" returned: 0 in 0.689s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:56 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-082b5f48-583d-4925-85cf-93510b8cd8a9" released by "delete_volume" :: held 1.650s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9" returned: 0 in 0.865s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01822a0a-e750-4ea2-b972-001bd09675ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Creating direct copy from snapshot {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3357fd76-2cb3-414d-9d1d-bf6dcc3c3daa]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Created reservations ['06618043-d610-4d9d-b4ff-67e09487cce6', 'ee615834-717b-40f6-8b87-6b90a99c365d', '36646d91-7bc8-4225-b09a-6fbdd358b040', '41e7fe74-598b-46a9-9414-16bca711df70'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:57 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea Jul 06 12:17:57 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:57 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:17:57 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "cinder-401dfe9e-9eab-4880-b140-d067abf45e49-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-401dfe9e-9eab-4880-b140-d067abf45e49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "cinder-quobyte-27329531-b51c-4047-ad3d-84819474fa83" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-27329531-b51c-4047-ad3d-84819474fa83" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "cinder-quobyte-401dfe9e-9eab-4880-b140-d067abf45e49" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-401dfe9e-9eab-4880-b140-d067abf45e49" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Deleting offline snapshot 401dfe9e-9eab-4880-b140-d067abf45e49 of volume 27329531-b51c-4047-ad3d-84819474fa83 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] snapshot_file for this snap is: volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae90f632-2709-43c0-ad2c-b929e3f9e917]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:57 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f7a97014-d214-40b8-b97b-205b70602018 tempest-VolumeQuotasAdminTestJSON-25951270 None] Transfer volume completed successfully. Jul 06 12:17:57 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49 Jul 06 12:17:57 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:57 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea" returned: 0 in 0.941s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG cinder.utils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Path /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-71341fec-4271-4652-8590-5d01ef6c43cc not found in is_blk_device check {{(pid=86761) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-71341fec-4271-4652-8590-5d01ef6c43cc {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:57 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.817s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:57 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-71341fec-4271-4652-8590-5d01ef6c43cc Jul 06 12:17:57 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Deleted volume successfully. Jul 06 12:17:57 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-96eddf86-962b-4568-a9c6-25d1556e951e tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-082b5f48-583d-4925-85cf-93510b8cd8a9-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:58 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49" returned: 0 in 0.966s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27329531-b51c-4047-ad3d-84819474fa83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:17:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ca55c3-1621-4f8f-8514-fa76c9f81f0e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Acquiring lock "cinder-eb3ad839-0292-4208-9168-c0235bb633a2-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:58 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83 Jul 06 12:17:58 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Lock "cinder-eb3ad839-0292-4208-9168-c0235bb633a2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Acquiring lock "cinder-quobyte-eb3ad839-0292-4208-9168-c0235bb633a2" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Lock "cinder-quobyte-eb3ad839-0292-4208-9168-c0235bb633a2" acquired by "delete_volume" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9c3d1a-b98a-4a46-99dd-703ff3ac23d3]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-eb3ad839-0292-4208-9168-c0235bb633a2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:58 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-eb3ad839-0292-4208-9168-c0235bb633a2 Jul 06 12:17:58 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:00 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83" returned: 0 in 1.799s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:00 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-eb3ad839-0292-4208-9168-c0235bb633a2" returned: 0 in 1.615s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-eb3ad839-0292-4208-9168-c0235bb633a2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:00 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49 Jul 06 12:18:00 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:00 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-eb3ad839-0292-4208-9168-c0235bb633a2 Jul 06 12:18:00 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:02 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49" returned: 0 in 1.692s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:02 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49 Jul 06 12:18:02 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:02 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-eb3ad839-0292-4208-9168-c0235bb633a2" returned: 0 in 1.802s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Lock "cinder-quobyte-eb3ad839-0292-4208-9168-c0235bb633a2" released by "delete_volume" :: held 3.481s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:02 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Created reservations ['cc8463a0-9685-4045-8ea0-61e2288e3d92', '8d900b10-1c89-4ee9-beac-4f830cae9241', '28bb0482-40ed-4b05-ba14-fd797f372489', '0a8eb128-0e0e-4658-bd1c-02926860aab6'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:02 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:02 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:02 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:18:02 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:04 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83.401dfe9e-9eab-4880-b140-d067abf45e49" returned: 0 in 2.123s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:04 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.525s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:04 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:04 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Deleted volume successfully. Jul 06 12:18:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-401dfe9e-9eab-4880-b140-d067abf45e49" released by "_delete_snapshot" :: held 6.750s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:04 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d1a83db4-26b7-4008-8df4-7e1284ef9ae2 tempest-VolumeQuotasAdminTestJSON-1525139768 None] Lock "cinder-eb3ad839-0292-4208-9168-c0235bb633a2-delete_volume" released by "delete_volume" :: held 5.575s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-27329531-b51c-4047-ad3d-84819474fa83" released by "delete_snapshot" :: held 6.788s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-71341fec-4271-4652-8590-5d01ef6c43cc" returned: 0 in 6.399s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:04 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5a2ebf-6f3e-4bda-9bc6-6f10a24c3d89]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:04 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Created reservations ['7d174a54-96a0-4ebf-87d5-128fdaa175a4', '10afb170-9572-41db-9f6a-3da7064c026c', '54963c94-a360-49a3-8544-cb0a8a2ffdae', '948d28a9-2178-485c-a7d5-0b6ead839680'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:04 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea Jul 06 12:18:04 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:04 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Delete snapshot completed successfully. Jul 06 12:18:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-13ae26c8-6d5a-418f-8b7c-b7530db0a956 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-401dfe9e-9eab-4880-b140-d067abf45e49-delete_snapshot" released by "delete_snapshot" :: held 7.013s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "cinder-27329531-b51c-4047-ad3d-84819474fa83-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-27329531-b51c-4047-ad3d-84819474fa83-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "cinder-quobyte-27329531-b51c-4047-ad3d-84819474fa83" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-27329531-b51c-4047-ad3d-84819474fa83" acquired by "delete_volume" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:05 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecb5151-40f3-420d-85dd-376aec3f3cbe]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:05 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83 Jul 06 12:18:05 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:05 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea" returned: 0 in 1.208s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:05 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea, size 1024.00 MB, duration 6.40 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-71341fec-4271-4652-8590-5d01ef6c43cc {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:18:05 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Converted 1024.00 MB image at 160.00 MB/s Jul 06 12:18:05 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-71341fec-4271-4652-8590-5d01ef6c43cc is being set with open permissions: ugo+rw Jul 06 12:18:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-71341fec-4271-4652-8590-5d01ef6c43cc {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:05 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-71341fec-4271-4652-8590-5d01ef6c43cc Jul 06 12:18:05 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:06 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83" returned: 0 in 0.958s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:06 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83 Jul 06 12:18:06 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:06 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-71341fec-4271-4652-8590-5d01ef6c43cc" returned: 0 in 0.775s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-quobyte-71341fec-4271-4652-8590-5d01ef6c43cc" released by "_copy_volume_from_snapshot" :: held 10.405s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-quobyte-388bd124-0f09-497a-8259-ba0b5e2ddbd9-71341fec-4271-4652-8590-5d01ef6c43cc" released by "_create_volume_from_snapshot" :: held 10.498s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.572s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.349s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c1cbf3f6-7286-4a1e-b3ea-1dab4459acc6,created_at=2026-07-06T10:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-379976387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1cbf3f6-7286-4a1e-b3ea-1dab4459acc6,host='devstack@QuobyteHD#QuobyteHD',id=fabc59e4-7c5a-4d13-ab99-afd82965d832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aebfcb21abe34d10a1de3765da086f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:56Z,use_quota=True,user_id='71cdfd826dff47d091093b9cafb88692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e62bd4d-81f7-4aba-96f4-48b6030f4fdc),volume_type_id=6e62bd4d-81f7-4aba-96f4-48b6030f4fdc)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Creating volume fabc59e4-7c5a-4d13-ab99-afd82965d832 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:18:06 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:06 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 1073741824 Jul 06 12:18:06 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8481a2bb-53aa-4f34-8b26-8868e809be83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71341fec-4271-4652-8590-5d01ef6c43cc', 'volume_size': 1, 'snapshot_id': '388bd124-0f09-497a-8259-ba0b5e2ddbd9'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935a0c5d-6948-475f-82a5-2dc9e021aade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:06 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Volume volume-71341fec-4271-4652-8590-5d01ef6c43cc (71341fec-4271-4652-8590-5d01ef6c43cc): created successfully Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935a0c5d-6948-475f-82a5-2dc9e021aade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Flow 'volume_create_manager' (5a911f01-ced7-41c0-bf28-a0aad0bd1fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:06 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-80681ff0-85f1-484a-9833-544f7fd15da8 tempest-SnapshotDependencyTests-267601800 None] Created volume successfully. Jul 06 12:18:07 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-27329531-b51c-4047-ad3d-84819474fa83" returned: 0 in 0.847s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-quobyte-27329531-b51c-4047-ad3d-84819474fa83" released by "delete_volume" :: held 1.939s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Created reservations ['a6abdf92-0838-4359-b016-4249551b3d37', 'd3b50878-b332-41e3-85ed-9b035fa479da', 'ef21eefe-a41e-4a80-a2a9-21fe229b5b0e', '94dffdfa-202e-4358-a7a4-d0cd7134a79f'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:07 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:18:07 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "cinder-388bd124-0f09-497a-8259-ba0b5e2ddbd9-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:07 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 1073741824" returned: 0 in 1.357s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-388bd124-0f09-497a-8259-ba0b5e2ddbd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "cinder-quobyte-01822a0a-e750-4ea2-b972-001bd09675ea" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-quobyte-01822a0a-e750-4ea2-b972-001bd09675ea" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "cinder-quobyte-388bd124-0f09-497a-8259-ba0b5e2ddbd9" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-quobyte-388bd124-0f09-497a-8259-ba0b5e2ddbd9" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Deleting offline snapshot 388bd124-0f09-497a-8259-ba0b5e2ddbd9 of volume 01822a0a-e750-4ea2-b972-001bd09675ea {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] snapshot_file for this snap is: volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[850a975c-5d8a-4a18-a779-6c0f044c43cb]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:07 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 Jul 06 12:18:07 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:08 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 Jul 06 12:18:08 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:08 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.203s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:08 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:08 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Deleted volume successfully. Jul 06 12:18:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab6efe9e-64e2-4ea4-9c9f-2180cbe4f051 tempest-CreateVolumesFromSnapshotTest-463165396 None] Lock "cinder-27329531-b51c-4047-ad3d-84819474fa83-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:08 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832" returned: 0 in 0.985s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] <== create_volume: return (2520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:18:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.526s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f59ff98-5ee6-49ca-94bf-95ef8e06faa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fabc59e4-7c5a-4d13-ab99-afd82965d832', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac0940c-569a-47f5-8cce-f5c1f18a6069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:08 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Volume volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 (fabc59e4-7c5a-4d13-ab99-afd82965d832): created successfully Jul 06 12:18:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac0940c-569a-47f5-8cce-f5c1f18a6069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Flow 'volume_create_manager' (62324abb-b180-488d-9c2e-0637e1f90967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:09 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-08b109d6-9794-45c7-a86d-8c1b261120c8 tempest-GroupSnapshotsTest-1727086509 None] Created volume successfully. Jul 06 12:18:09 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9" returned: 0 in 1.061s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01822a0a-e750-4ea2-b972-001bd09675ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:18:09 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[57890fae-cd47-4595-872d-b228e839aa78]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:09 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea Jul 06 12:18:09 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:09 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] GroupSnapshot a9e25129-8381-4c1b-b521-4152aa8ec534: creating. Jul 06 12:18:09 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] Group snapshot a9e25129-8381-4c1b-b521-4152aa8ec534: creating. {{(pid=86761) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 12:18:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] Creating offline snapshot a4d83e3e-211a-449a-b83d-4bd2500a43c0 of volume fabc59e4-7c5a-4d13-ab99-afd82965d832 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:18:09 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d119c59-ec1e-4886-9f4e-2e827c566aa1]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:09 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 Jul 06 12:18:09 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:10 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea" returned: 0 in 1.074s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:10 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 Jul 06 12:18:10 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:10 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832" returned: 0 in 1.119s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:10 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 1G Jul 06 12:18:10 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:11 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9" returned: 0 in 1.021s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:11 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9 Jul 06 12:18:11 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:11 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 1G" returned: 0 in 1.030s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:11 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 Jul 06 12:18:11 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:11 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea.388bd124-0f09-497a-8259-ba0b5e2ddbd9" returned: 0 in 0.820s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-quobyte-388bd124-0f09-497a-8259-ba0b5e2ddbd9" released by "_delete_snapshot" :: held 4.206s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-quobyte-01822a0a-e750-4ea2-b972-001bd09675ea" released by "delete_snapshot" :: held 4.250s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:12 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Created reservations ['31c3e25e-72a7-4468-aecd-2aa6ac1a30a4', 'ff25aea2-d3eb-4dbf-b86e-7a04b23c7f0f', 'd7810929-8812-42a3-9fd7-a182ba911520', 'fe9353af-8f95-4c1b-b69d-23d5d457094f'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:12 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Delete snapshot completed successfully. Jul 06 12:18:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ce5a7a3a-f861-4a1c-9d78-5f5ad056a9b4 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-388bd124-0f09-497a-8259-ba0b5e2ddbd9-delete_snapshot" released by "delete_snapshot" :: held 4.470s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:12 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0" returned: 0 in 0.849s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:12 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:18:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:12 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 Jul 06 12:18:12 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "cinder-01822a0a-e750-4ea2-b972-001bd09675ea-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-01822a0a-e750-4ea2-b972-001bd09675ea-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "cinder-quobyte-01822a0a-e750-4ea2-b972-001bd09675ea" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-quobyte-01822a0a-e750-4ea2-b972-001bd09675ea" acquired by "delete_volume" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:13 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e754fe9-994c-4646-b5ac-9797e53926cf]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:13 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea Jul 06 12:18:13 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:13 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0" returned: 0 in 0.900s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:13 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.info Jul 06 12:18:13 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:14 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea" returned: 0 in 1.050s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:14 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea Jul 06 12:18:14 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:14 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.info" returned: 0 in 0.930s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:14 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:18:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:14 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.info Jul 06 12:18:14 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:15 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01822a0a-e750-4ea2-b972-001bd09675ea" returned: 0 in 0.871s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-quobyte-01822a0a-e750-4ea2-b972-001bd09675ea" released by "delete_volume" :: held 2.016s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:15 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Created reservations ['3e5d6c71-ffab-48cc-8ffb-f24ba0110178', 'ac899308-733b-428a-99e9-a16b82e8339d', '63715d48-ae4c-442a-9fa9-29e46c0a5ba6', '38c8469a-0901-4b51-b4b7-cd3b000a6880'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:15 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.info" returned: 0 in 0.882s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.852s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:15 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:18:15 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:15 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-1cfb3783-62f7-4dde-b84d-1867bcb50395 tempest-GroupSnapshotsTest-1727086509 None] group_snapshot a9e25129-8381-4c1b-b521-4152aa8ec534: created successfully Jul 06 12:18:16 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.885s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:16 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:16 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Deleted volume successfully. Jul 06 12:18:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9afe792f-4608-4575-8bae-c71f7d457e59 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-01822a0a-e750-4ea2-b972-001bd09675ea-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "cinder-71341fec-4271-4652-8590-5d01ef6c43cc-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-71341fec-4271-4652-8590-5d01ef6c43cc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "cinder-quobyte-71341fec-4271-4652-8590-5d01ef6c43cc" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-quobyte-71341fec-4271-4652-8590-5d01ef6c43cc" acquired by "delete_volume" :: waited 0.029s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:16 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5e8a34-ad56-445d-8295-af1695eec6c5]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-71341fec-4271-4652-8590-5d01ef6c43cc {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:17 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-71341fec-4271-4652-8590-5d01ef6c43cc Jul 06 12:18:17 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "cinder-quobyte-a4d83e3e-211a-449a-b83d-4bd2500a43c0-a31be34b-cc16-422e-9fe5-d19f8618f008" by "_create_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-a4d83e3e-211a-449a-b83d-4bd2500a43c0-a31be34b-cc16-422e-9fe5-d19f8618f008" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Creating volume a31be34b-cc16-422e-9fe5-d19f8618f008 from snapshot a4d83e3e-211a-449a-b83d-4bd2500a43c0 {{(pid=86761) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "cinder-quobyte-a31be34b-cc16-422e-9fe5-d19f8618f008" by "_copy_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-a31be34b-cc16-422e-9fe5-d19f8618f008" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] snapshot: a4d83e3e-211a-449a-b83d-4bd2500a43c0, volume: a31be34b-cc16-422e-9fe5-d19f8618f008, {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1c75f6-8f61-4db7-90f1-dcf662ac718f]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:17 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 Jul 06 12:18:17 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:18 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-71341fec-4271-4652-8590-5d01ef6c43cc" returned: 0 in 1.394s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-71341fec-4271-4652-8590-5d01ef6c43cc {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:18 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-71341fec-4271-4652-8590-5d01ef6c43cc Jul 06 12:18:18 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:18 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0" returned: 0 in 1.181s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fabc59e4-7c5a-4d13-ab99-afd82965d832(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:18:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:18:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Creating direct copy from snapshot {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:18:18 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cd96f9-0be6-4c6d-8e7a-09239dbf7ac7]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:18 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 Jul 06 12:18:18 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:19 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-71341fec-4271-4652-8590-5d01ef6c43cc" returned: 0 in 1.048s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:19 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-quobyte-71341fec-4271-4652-8590-5d01ef6c43cc" released by "delete_volume" :: held 2.514s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:19 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Created reservations ['3ce2accf-6c3b-4480-9e9c-6eb54e8ebdb0', 'c0558246-5876-499a-835b-6e5d10ce9739', '7ffbf12d-b09a-4067-8564-00ce52339895', '19d874ed-4683-4140-aad0-a1a14e9967ad'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:19 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:18:19 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:19 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832" returned: 0 in 1.012s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:19 devstack cinder-volume[86761]: DEBUG cinder.utils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Path /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a31be34b-cc16-422e-9fe5-d19f8618f008 not found in is_blk_device check {{(pid=86761) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:18:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a31be34b-cc16-422e-9fe5-d19f8618f008 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:19 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a31be34b-cc16-422e-9fe5-d19f8618f008 Jul 06 12:18:19 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:20 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.744s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:20 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:20 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Deleted volume successfully. Jul 06 12:18:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5cfb03ad-023e-4506-b928-5f2ea19634d6 tempest-SnapshotDependencyTests-267601800 None] Lock "cinder-71341fec-4271-4652-8590-5d01ef6c43cc-delete_volume" released by "delete_volume" :: held 3.563s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:25 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a31be34b-cc16-422e-9fe5-d19f8618f008" returned: 0 in 6.068s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:25 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3170f6e8-c956-4704-9dea-fe5cc7779453]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:25 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 Jul 06 12:18:25 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:27 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832" returned: 0 in 1.527s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:27 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a31be34b-cc16-422e-9fe5-d19f8618f008 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:18:27 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Converted 1024.00 MB image at 168.73 MB/s Jul 06 12:18:27 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a31be34b-cc16-422e-9fe5-d19f8618f008 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:18:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a31be34b-cc16-422e-9fe5-d19f8618f008 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:27 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a31be34b-cc16-422e-9fe5-d19f8618f008 Jul 06 12:18:27 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:28 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a31be34b-cc16-422e-9fe5-d19f8618f008" returned: 0 in 1.046s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:28 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-a31be34b-cc16-422e-9fe5-d19f8618f008" released by "_copy_volume_from_snapshot" :: held 10.997s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:28 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-a4d83e3e-211a-449a-b83d-4bd2500a43c0-a31be34b-cc16-422e-9fe5-d19f8618f008" released by "_create_volume_from_snapshot" :: held 11.045s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.065s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:28 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d7db3911-503f-4f63-bd4a-3b6913ddc849 tempest-GroupSnapshotsTest-1727086509 None] Create group from source-snapshot-a9e25129-8381-4c1b-b521-4152aa8ec534 completed successfully. Jul 06 12:18:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "cinder-quobyte-a31be34b-cc16-422e-9fe5-d19f8618f008" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-a31be34b-cc16-422e-9fe5-d19f8618f008" acquired by "delete_volume" :: waited 0.033s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:29 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e501a5-cda1-46ef-8271-f43c112bc07d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a31be34b-cc16-422e-9fe5-d19f8618f008 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:29 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a31be34b-cc16-422e-9fe5-d19f8618f008 Jul 06 12:18:29 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:30 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a31be34b-cc16-422e-9fe5-d19f8618f008" returned: 0 in 1.020s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a31be34b-cc16-422e-9fe5-d19f8618f008 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:30 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a31be34b-cc16-422e-9fe5-d19f8618f008 Jul 06 12:18:30 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:31 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a31be34b-cc16-422e-9fe5-d19f8618f008" returned: 0 in 0.890s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-a31be34b-cc16-422e-9fe5-d19f8618f008" released by "delete_volume" :: held 1.978s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Created reservations ['34d1bc1f-9cca-4f58-9cd1-64c7c8ce7488'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:31 devstack cinder-volume[86761]: WARNING cinder.quota [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1914326587 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1914326587, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:18:31 devstack cinder-volume[86761]: WARNING cinder.quota [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1914326587 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1914326587, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Created reservations ['e331bc07-ca13-46e4-80f6-9e2233848e79', '1404c7f5-94ab-44c9-9cd5-7b6213a6e3f4', '6da9c763-4d8c-45f7-95e2-c56de9e87d65', 'fdd96350-92bc-4518-abe6-343b9164edca'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:31 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:18:31 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:31 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] group_snapshot a9e25129-8381-4c1b-b521-4152aa8ec534: deleting Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] group_snapshot a9e25129-8381-4c1b-b521-4152aa8ec534: deleting {{(pid=86761) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "cinder-quobyte-fabc59e4-7c5a-4d13-ab99-afd82965d832" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-fabc59e4-7c5a-4d13-ab99-afd82965d832" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "cinder-quobyte-a4d83e3e-211a-449a-b83d-4bd2500a43c0" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-a4d83e3e-211a-449a-b83d-4bd2500a43c0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] Deleting offline snapshot a4d83e3e-211a-449a-b83d-4bd2500a43c0 of volume fabc59e4-7c5a-4d13-ab99-afd82965d832 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] snapshot_file for this snap is: volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[908e2675-5be0-4ca0-af59-84681e4fc401]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:32 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 Jul 06 12:18:32 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:32 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.059s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:32 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:32 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-9cc66cc8-f815-4300-9103-1390b19bed2f tempest-GroupSnapshotsTest-1727086509 None] Delete group completed successfully. Jul 06 12:18:33 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0" returned: 0 in 1.178s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fabc59e4-7c5a-4d13-ab99-afd82965d832(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:18:33 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e766157-e836-4264-ac12-dbf5d2ea58ba]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:33 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 Jul 06 12:18:33 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:34 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832" returned: 0 in 0.946s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:34 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 Jul 06 12:18:34 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:35 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0" returned: 0 in 0.926s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:35 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0 Jul 06 12:18:35 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:35 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832.a4d83e3e-211a-449a-b83d-4bd2500a43c0" returned: 0 in 0.862s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-a4d83e3e-211a-449a-b83d-4bd2500a43c0" released by "_delete_snapshot" :: held 4.083s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-fabc59e4-7c5a-4d13-ab99-afd82965d832" released by "delete_snapshot" :: held 4.114s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:36 devstack cinder-volume[86761]: WARNING cinder.quota [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1914326587 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1914326587, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:18:36 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] Created reservations ['cf114aa5-4386-4a68-b1cf-8a7738b4df43', 'b7408d41-0702-47c9-95c5-053f786605c6', '1117b97b-834d-493d-8913-802f5f86962e', '622880d3-a097-4c6b-ae26-6f8ae78dfdff'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:36 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-507ca938-9bca-45a1-a470-3af7ccc41557 tempest-GroupSnapshotsTest-1727086509 None] group_snapshot a9e25129-8381-4c1b-b521-4152aa8ec534: deleted successfully Jul 06 12:18:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "cinder-quobyte-fabc59e4-7c5a-4d13-ab99-afd82965d832" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-fabc59e4-7c5a-4d13-ab99-afd82965d832" acquired by "delete_volume" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:36 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1816944c-147b-4ff4-af82-114d99742360]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:36 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 Jul 06 12:18:36 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:37 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832" returned: 0 in 1.106s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:37 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832 Jul 06 12:18:37 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:38 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-fabc59e4-7c5a-4d13-ab99-afd82965d832" returned: 0 in 1.039s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-fabc59e4-7c5a-4d13-ab99-afd82965d832" released by "delete_volume" :: held 2.235s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:38 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Created reservations ['a336f3e5-52b2-4245-9f80-2d08c4d94d99'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:39 devstack cinder-volume[86761]: WARNING cinder.db.api [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1914326587'] Jul 06 12:18:39 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Created reservations ['fe39b2c2-4dd4-4c25-ab93-44c5efbdb9f5', '847ca12c-73c8-4b3b-9839-94b946299dc2', '3420f1bb-6020-4d38-bca7-0fc20c3bbb20', '812f9722-335a-4ef0-8018-6793d035e229'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:39 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:18:39 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:40 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.778s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:40 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-1424578f-ecc2-44b6-b6b1-590c7a324fa6 tempest-GroupSnapshotsTest-1727086509 None] Delete group completed successfully. Jul 06 12:18:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-41ddbd06-b274-4931-b81e-8dc7247eda2e tempest-GroupSnapshotsTest-1727086509 None] Group tempest-GroupSnapshotsTest-Group-760998448: creating Jul 06 12:18:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-41ddbd06-b274-4931-b81e-8dc7247eda2e tempest-GroupSnapshotsTest-1727086509 None] Group tempest-GroupSnapshotsTest-Group-760998448: created successfully Jul 06 12:18:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-41ddbd06-b274-4931-b81e-8dc7247eda2e tempest-GroupSnapshotsTest-1727086509 None] Create group completed successfully. Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Flow 'volume_create_manager' (f1acf8ff-92c1-4f51-9012-73af59c0d6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98ff6b4-8992-4a6f-81f4-9f5d25ab498b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98ff6b4-8992-4a6f-81f4-9f5d25ab498b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-157715312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4c24e84-2d3c-4d7a-bea5-f1b2f6933c61,host='devstack@QuobyteHD#QuobyteHD',id=673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aebfcb21abe34d10a1de3765da086f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:43Z,use_quota=True,user_id='71cdfd826dff47d091093b9cafb88692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(236db215-c814-4285-ae72-1ea6d073f670),volume_type_id=236db215-c814-4285-ae72-1ea6d073f670)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bc1ae1-6fa3-4c5f-b5a4-d55e7e08440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bc1ae1-6fa3-4c5f-b5a4-d55e7e08440d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19875d27-d637-40cf-bc75-ec8724b1ef0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19875d27-d637-40cf-bc75-ec8724b1ef0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd', 'volume_name': 'volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e6a911-04ac-4b1e-b69a-ee775cdaed85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e6a911-04ac-4b1e-b69a-ee775cdaed85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4158428-cc19-4ab3-953c-472f58d035d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:42 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Volume 673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd', 'volume_size': 1} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f4c24e84-2d3c-4d7a-bea5-f1b2f6933c61,created_at=2026-07-06T10:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-157715312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4c24e84-2d3c-4d7a-bea5-f1b2f6933c61,host='devstack@QuobyteHD#QuobyteHD',id=673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aebfcb21abe34d10a1de3765da086f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:43Z,use_quota=True,user_id='71cdfd826dff47d091093b9cafb88692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(236db215-c814-4285-ae72-1ea6d073f670),volume_type_id=236db215-c814-4285-ae72-1ea6d073f670)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Creating volume 673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:18:42 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:18:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:42 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd 1073741824 Jul 06 12:18:42 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:43 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd 1073741824" returned: 0 in 0.998s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:43 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd Jul 06 12:18:43 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:44 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd" returned: 0 in 0.756s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:44 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:18:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4158428-cc19-4ab3-953c-472f58d035d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125a944b-bcb8-493c-867c-30889f897bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:44 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Volume volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd (673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd): created successfully Jul 06 12:18:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125a944b-bcb8-493c-867c-30889f897bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Flow 'volume_create_manager' (f1acf8ff-92c1-4f51-9012-73af59c0d6f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:44 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-989062c2-7b88-4d2d-b4a0-b2a8785fd200 tempest-GroupSnapshotsTest-1727086509 None] Created volume successfully. Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Flow 'volume_create_manager' (53cbe9a4-e8d0-49e6-8d7d-67d65847a9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab9c443-7c0d-4aac-9193-aad97ec37eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab9c443-7c0d-4aac-9193-aad97ec37eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1902066860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4c24e84-2d3c-4d7a-bea5-f1b2f6933c61,host='devstack@QuobyteHD#QuobyteHD',id=ac0f0c39-17f5-4509-b464-15bea6a8eb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aebfcb21abe34d10a1de3765da086f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:46Z,use_quota=True,user_id='71cdfd826dff47d091093b9cafb88692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(236db215-c814-4285-ae72-1ea6d073f670),volume_type_id=236db215-c814-4285-ae72-1ea6d073f670)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7df89e-998c-4b9b-bc42-7050882b1c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7df89e-998c-4b9b-bc42-7050882b1c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b600e50e-8509-4f44-8279-f518e23688a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b600e50e-8509-4f44-8279-f518e23688a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac0f0c39-17f5-4509-b464-15bea6a8eb9b', 'volume_name': 'volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a279832f-c6b8-4da5-b3b9-c3a6cae57895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a279832f-c6b8-4da5-b3b9-c3a6cae57895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96a01af-fca7-4364-adc5-7cdb55b8a78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:45 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Volume ac0f0c39-17f5-4509-b464-15bea6a8eb9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b', 'volume_size': 1} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f4c24e84-2d3c-4d7a-bea5-f1b2f6933c61,created_at=2026-07-06T10:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1902066860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4c24e84-2d3c-4d7a-bea5-f1b2f6933c61,host='devstack@QuobyteHD#QuobyteHD',id=ac0f0c39-17f5-4509-b464-15bea6a8eb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aebfcb21abe34d10a1de3765da086f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:46Z,use_quota=True,user_id='71cdfd826dff47d091093b9cafb88692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(236db215-c814-4285-ae72-1ea6d073f670),volume_type_id=236db215-c814-4285-ae72-1ea6d073f670)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Creating volume ac0f0c39-17f5-4509-b464-15bea6a8eb9b {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:18:45 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:18:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:45 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b 1073741824 Jul 06 12:18:45 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:46 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b 1073741824" returned: 0 in 0.939s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:46 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b Jul 06 12:18:46 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:47 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b" returned: 0 in 0.758s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:18:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96a01af-fca7-4364-adc5-7cdb55b8a78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7c9fd0-228e-494b-9fe3-0e5ef64494f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:47 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Volume volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b (ac0f0c39-17f5-4509-b464-15bea6a8eb9b): created successfully Jul 06 12:18:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7c9fd0-228e-494b-9fe3-0e5ef64494f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Flow 'volume_create_manager' (53cbe9a4-e8d0-49e6-8d7d-67d65847a9a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:47 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0a176caf-2b5f-403b-b7a5-10f0d9eeef81 tempest-GroupSnapshotsTest-1727086509 None] Created volume successfully. Jul 06 12:18:48 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-8393d940-f4a1-4bbd-bc07-5dce947b0f81 tempest-GroupSnapshotsTest-1727086509 None] Update group completed successfully. Jul 06 12:18:49 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2297ea95-15d2-4ce3-a1f5-8aa7786c5983 tempest-GroupSnapshotsTest-1727086509 None] Update group completed successfully. Jul 06 12:18:50 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b82376e6-3839-41ae-9a92-9ec61423d95e tempest-GroupSnapshotsTest-1727086509 None] Update group completed successfully. Jul 06 12:18:51 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=126,cinder:SELECT=97,cinder:DELETE=8,cinder:INSERT=30 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:18:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-93b72a50-55af-472e-9e52-8f943bd68db1 tempest-GroupSnapshotsTest-1727086509 None] Update group completed successfully. Jul 06 12:18:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:18:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:52 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:18:52 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:53 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.748s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:18:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:18:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:18:53 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] GroupSnapshot a579b110-b6f7-4ca5-94be-cee4e3842f33: creating. Jul 06 12:18:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Group snapshot a579b110-b6f7-4ca5-94be-cee4e3842f33: creating. {{(pid=86761) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 12:18:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Creating offline snapshot 6e684ab5-b5af-4a8f-ba0f-be3811c91893 of volume ac0f0c39-17f5-4509-b464-15bea6a8eb9b {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:18:53 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6595441-961e-4d1d-9d75-c43230bbb833]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:53 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b Jul 06 12:18:53 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:54 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b" returned: 0 in 1.035s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:54 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893 1G Jul 06 12:18:54 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:55 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893 1G" returned: 0 in 1.031s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:55 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893 Jul 06 12:18:55 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:56 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893" returned: 0 in 0.804s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:56 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:18:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:56 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893 Jul 06 12:18:56 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:57 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893" returned: 0 in 0.704s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:57 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=101,cinder:INSERT=21,cinder:UPDATE=104,cinder:DELETE=5 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:18:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:57 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.info Jul 06 12:18:57 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:57 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.info" returned: 0 in 0.701s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:58 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:18:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:58 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.info Jul 06 12:18:58 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:58 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.info" returned: 0 in 0.812s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.184s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Creating offline snapshot b5d38a09-ea92-477f-b2d1-59588d9fe3f6 of volume 673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:18:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3336e7-9295-4c24-be40-812c2f8a7866]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:58 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd Jul 06 12:18:58 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:59 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd" returned: 0 in 0.848s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:59 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6 1G Jul 06 12:18:59 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:00 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6 1G" returned: 0 in 0.901s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:00 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6 Jul 06 12:19:00 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:01 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6" returned: 0 in 0.776s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:01 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:19:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:01 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6 Jul 06 12:19:01 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:02 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6" returned: 0 in 0.775s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:02 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.info Jul 06 12:19:02 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:02 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.info" returned: 0 in 0.757s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:02 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:19:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:03 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.info Jul 06 12:19:03 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:03 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.info" returned: 0 in 0.803s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.971s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:03 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0855a228-ec45-4876-98f2-d71924ed7f9c tempest-GroupSnapshotsTest-1727086509 None] group_snapshot a579b110-b6f7-4ca5-94be-cee4e3842f33: created successfully Jul 06 12:19:04 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] group_snapshot a579b110-b6f7-4ca5-94be-cee4e3842f33: deleting Jul 06 12:19:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] group_snapshot a579b110-b6f7-4ca5-94be-cee4e3842f33: deleting {{(pid=86761) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 12:19:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "cinder-quobyte-ac0f0c39-17f5-4509-b464-15bea6a8eb9b" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-ac0f0c39-17f5-4509-b464-15bea6a8eb9b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "cinder-quobyte-6e684ab5-b5af-4a8f-ba0f-be3811c91893" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-6e684ab5-b5af-4a8f-ba0f-be3811c91893" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Deleting offline snapshot 6e684ab5-b5af-4a8f-ba0f-be3811c91893 of volume ac0f0c39-17f5-4509-b464-15bea6a8eb9b {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:19:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] snapshot_file for this snap is: volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:19:04 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83b8bf8-ab74-4113-98bb-2a9ade7be035]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:04 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893 Jul 06 12:19:04 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:05 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893" returned: 0 in 0.926s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:19:05 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c65987-8031-4638-aed6-0d32bb881866]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:05 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b Jul 06 12:19:05 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:06 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b" returned: 0 in 0.968s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:06 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893 Jul 06 12:19:06 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:07 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893" returned: 0 in 0.875s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:07 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893 Jul 06 12:19:07 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:08 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b.6e684ab5-b5af-4a8f-ba0f-be3811c91893" returned: 0 in 0.715s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-6e684ab5-b5af-4a8f-ba0f-be3811c91893" released by "_delete_snapshot" :: held 3.668s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-ac0f0c39-17f5-4509-b464-15bea6a8eb9b" released by "delete_snapshot" :: held 3.703s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "cinder-quobyte-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "cinder-quobyte-b5d38a09-ea92-477f-b2d1-59588d9fe3f6" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-b5d38a09-ea92-477f-b2d1-59588d9fe3f6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Deleting offline snapshot b5d38a09-ea92-477f-b2d1-59588d9fe3f6 of volume 673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:19:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] snapshot_file for this snap is: volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:19:08 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd4ce37-0efc-4a13-96de-7af2973d0cdf]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:08 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6 Jul 06 12:19:08 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:09 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6" returned: 0 in 1.200s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:19:09 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab595a94-4d23-4c37-bd7a-fd515f85fc49]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:09 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd Jul 06 12:19:09 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:10 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd" returned: 0 in 0.830s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:10 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6 Jul 06 12:19:10 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:11 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6" returned: 0 in 0.921s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:11 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6 Jul 06 12:19:11 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:11 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd.b5d38a09-ea92-477f-b2d1-59588d9fe3f6" returned: 0 in 0.692s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-b5d38a09-ea92-477f-b2d1-59588d9fe3f6" released by "_delete_snapshot" :: held 3.781s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd" released by "delete_snapshot" :: held 3.811s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:12 devstack cinder-volume[86761]: WARNING cinder.quota [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1732123442 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1732123442, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:19:12 devstack cinder-volume[86761]: WARNING cinder.quota [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1732123442 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1732123442, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:19:12 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Created reservations ['2c9f84b8-a704-4291-b0ef-436a370335e6', '92399600-d05e-44af-be63-8be7328468df', 'f6cf6168-53c4-4fa4-8ed7-d3d22f11e79b', '1d1beb0c-9747-4121-845f-b35b035ed9aa'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:12 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] Created reservations ['7bf77953-7a2c-44e6-8cc4-ea7d97051d48', '40c8d2e4-6c4b-4a89-8678-f1f07a8f8892', '3a7576f9-9a5b-448a-b690-26edfeefec92', 'd7fa020b-8978-4539-9f19-83c69269d837'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:12 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7ee38011-7ff0-448f-8f5f-8c9d3d48fa13 tempest-GroupSnapshotsTest-1727086509 None] group_snapshot a579b110-b6f7-4ca5-94be-cee4e3842f33: deleted successfully Jul 06 12:19:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "cinder-quobyte-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:13 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[27798166-1854-4c59-ac60-131741d6eb05]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:13 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd Jul 06 12:19:13 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Flow 'volume_create_manager' (dfdac319-f27a-4ac7-b197-990af1b7488c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c930435-26da-482d-ac76-cd8d0cd86c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c930435-26da-482d-ac76-cd8d0cd86c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1588363058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781048ba-8dc1-4248-8a2b-bf7044194d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5478c009d3104cc1b989f49f6ebd49f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:15Z,use_quota=True,user_id='44be4a5a19da41eaaddb7a86b458d37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd05f79-05f1-44e4-ad6b-3733eab6942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd05f79-05f1-44e4-ad6b-3733eab6942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cc3f70-d36f-4f27-9649-6a3577936c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cc3f70-d36f-4f27-9649-6a3577936c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '781048ba-8dc1-4248-8a2b-bf7044194d95', 'volume_name': 'volume-781048ba-8dc1-4248-8a2b-bf7044194d95', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7249dfc7-ca49-4cfe-acb5-442632e5d643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7249dfc7-ca49-4cfe-acb5-442632e5d643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2acbf33f-0e3f-443b-9a0f-33b325d75d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:14 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Volume 781048ba-8dc1-4248-8a2b-bf7044194d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-781048ba-8dc1-4248-8a2b-bf7044194d95', 'volume_size': 1} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1588363058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781048ba-8dc1-4248-8a2b-bf7044194d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5478c009d3104cc1b989f49f6ebd49f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:15Z,use_quota=True,user_id='44be4a5a19da41eaaddb7a86b458d37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Creating volume 781048ba-8dc1-4248-8a2b-bf7044194d95 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:19:14 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-781048ba-8dc1-4248-8a2b-bf7044194d95 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:14 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-781048ba-8dc1-4248-8a2b-bf7044194d95 1073741824 Jul 06 12:19:14 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:14 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd" returned: 0 in 0.999s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:14 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd Jul 06 12:19:14 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:15 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd" returned: 0 in 0.729s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-673ee1ee-fdf1-4d3c-a265-b7a30b2a30dd" released by "delete_volume" :: held 1.837s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "cinder-quobyte-ac0f0c39-17f5-4509-b464-15bea6a8eb9b" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-ac0f0c39-17f5-4509-b464-15bea6a8eb9b" acquired by "delete_volume" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:15 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa60249-4ac1-45c5-a643-03a1c2ce3967]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:15 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-781048ba-8dc1-4248-8a2b-bf7044194d95 1073741824" returned: 0 in 0.951s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:15 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b Jul 06 12:19:15 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-781048ba-8dc1-4248-8a2b-bf7044194d95 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:15 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-781048ba-8dc1-4248-8a2b-bf7044194d95 Jul 06 12:19:15 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:16 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b" returned: 0 in 0.803s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:16 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b Jul 06 12:19:16 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:16 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-781048ba-8dc1-4248-8a2b-bf7044194d95" returned: 0 in 0.775s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:19:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2acbf33f-0e3f-443b-9a0f-33b325d75d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-781048ba-8dc1-4248-8a2b-bf7044194d95', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76008530-98d7-4195-b7a4-c6e31289277e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:16 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Volume volume-781048ba-8dc1-4248-8a2b-bf7044194d95 (781048ba-8dc1-4248-8a2b-bf7044194d95): created successfully Jul 06 12:19:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76008530-98d7-4195-b7a4-c6e31289277e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Flow 'volume_create_manager' (dfdac319-f27a-4ac7-b197-990af1b7488c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:16 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-964b608c-be3f-4519-99c4-3f91376b65a7 tempest-VolumesActionsTest-371870880 None] Created volume successfully. Jul 06 12:19:17 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0f0c39-17f5-4509-b464-15bea6a8eb9b" returned: 0 in 0.721s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:17 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-ac0f0c39-17f5-4509-b464-15bea6a8eb9b" released by "delete_volume" :: held 1.600s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:17 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Created reservations ['7f161de6-3922-4d2e-8de7-1fea87a7c10c'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:17 devstack cinder-volume[86761]: WARNING cinder.quota [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1732123442 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1732123442, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:19:17 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Created reservations ['5508387e-0593-4c89-870a-08579040a445', '31cdcc9d-6d24-48e2-b643-f5b38b6136b5', '6137764a-69bd-453d-b82c-779cfd6cd211', '665295ce-78e5-421b-ba0b-35efdfb46e9e'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:17 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Created reservations ['41b2898e-0116-4cb1-aad4-4ef6cd63c722', '48d94539-8490-416e-9482-13283f7aeff3', 'becae4c1-4d16-4745-ac44-e5df3f4fb2b1', '6b2317d8-7a35-4e64-a878-61fe32b726be'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-59f9cffa-a039-4a39-9296-aaf6620c6aa2 tempest-VolumesActionsTest-371870880 None] Acquiring lock "cinder-781048ba-8dc1-4248-8a2b-bf7044194d95" by "attach_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-59f9cffa-a039-4a39-9296-aaf6620c6aa2 tempest-VolumesActionsTest-371870880 None] Lock "cinder-781048ba-8dc1-4248-8a2b-bf7044194d95" acquired by "attach_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:19 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-59f9cffa-a039-4a39-9296-aaf6620c6aa2 tempest-VolumesActionsTest-371870880 None] Attaching volume 781048ba-8dc1-4248-8a2b-bf7044194d95 to instance 978cb433-c2c2-4bd3-8e3e-2089e306d577 at mountpoint /dev/vdb on host None. Jul 06 12:19:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:21 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:19:21 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:21 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-59f9cffa-a039-4a39-9296-aaf6620c6aa2 tempest-VolumesActionsTest-371870880 None] Attach volume completed successfully. Jul 06 12:19:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-59f9cffa-a039-4a39-9296-aaf6620c6aa2 tempest-VolumesActionsTest-371870880 None] Lock "cinder-781048ba-8dc1-4248-8a2b-bf7044194d95" released by "attach_volume" :: held 3.245s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:22 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.784s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:22 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:19:22 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-8be2e232-cdc6-4639-9a70-da107152ebf3 tempest-GroupSnapshotsTest-1727086509 None] Delete group completed successfully. Jul 06 12:19:22 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-491eadcc-b28f-448e-8f81-b52ac8ce5cc2 tempest-VolumesActionsTest-1112924069 None] Terminate volume connection completed successfully. Jul 06 12:19:23 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-fda07fbc-8299-4c78-9f82-7160a52af769 tempest-GroupSnapshotsTest-1727086509 None] Group tempest-GroupSnapshotsTest-Group-1865340380: creating Jul 06 12:19:23 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-fda07fbc-8299-4c78-9f82-7160a52af769 tempest-GroupSnapshotsTest-1727086509 None] Group tempest-GroupSnapshotsTest-Group-1865340380: created successfully Jul 06 12:19:23 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-fda07fbc-8299-4c78-9f82-7160a52af769 tempest-GroupSnapshotsTest-1727086509 None] Create group completed successfully. Jul 06 12:19:23 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-491eadcc-b28f-448e-8f81-b52ac8ce5cc2 tempest-VolumesActionsTest-1112924069 None] Acquiring lock "cinder-781048ba-8dc1-4248-8a2b-bf7044194d95-detach_volume" by "detach_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:23 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-491eadcc-b28f-448e-8f81-b52ac8ce5cc2 tempest-VolumesActionsTest-1112924069 None] Lock "cinder-781048ba-8dc1-4248-8a2b-bf7044194d95-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:23 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-491eadcc-b28f-448e-8f81-b52ac8ce5cc2 tempest-VolumesActionsTest-1112924069 None] Detaching volume 781048ba-8dc1-4248-8a2b-bf7044194d95 from instance 978cb433-c2c2-4bd3-8e3e-2089e306d577. Jul 06 12:19:23 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-491eadcc-b28f-448e-8f81-b52ac8ce5cc2 tempest-VolumesActionsTest-1112924069 None] Detach volume completed successfully. Jul 06 12:19:23 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-491eadcc-b28f-448e-8f81-b52ac8ce5cc2 tempest-VolumesActionsTest-1112924069 None] Lock "cinder-781048ba-8dc1-4248-8a2b-bf7044194d95-detach_volume" released by "detach_volume" :: held 0.086s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f94fd635-9602-41fd-ba5c-932b8d82abeb tempest-VolumesActionsTest-371870880 None] Acquiring lock "cinder-781048ba-8dc1-4248-8a2b-bf7044194d95-detach_volume" by "detach_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f94fd635-9602-41fd-ba5c-932b8d82abeb tempest-VolumesActionsTest-371870880 None] Lock "cinder-781048ba-8dc1-4248-8a2b-bf7044194d95-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:24 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f94fd635-9602-41fd-ba5c-932b8d82abeb tempest-VolumesActionsTest-371870880 None] Volume detach called, but volume not attached. Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f94fd635-9602-41fd-ba5c-932b8d82abeb tempest-VolumesActionsTest-371870880 None] Lock "cinder-781048ba-8dc1-4248-8a2b-bf7044194d95-detach_volume" released by "detach_volume" :: held 0.028s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Flow 'volume_create_manager' (3e6e5e2b-c504-4aa1-9cc8-d3f15d063c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58905552-cee1-4fef-a708-a05eb3d3dad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58905552-cee1-4fef-a708-a05eb3d3dad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-602736983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76674b43-973e-4cb1-b591-6022a464ff2d,host='devstack@QuobyteHD#QuobyteHD',id=a6907bd9-9952-4552-bd76-c28021e2f667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aebfcb21abe34d10a1de3765da086f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:25Z,use_quota=True,user_id='71cdfd826dff47d091093b9cafb88692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a34b9ef-79eb-4188-9100-a99f92dba058),volume_type_id=3a34b9ef-79eb-4188-9100-a99f92dba058)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9e1989-0adb-4fd0-8143-69e32b3fb95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9e1989-0adb-4fd0-8143-69e32b3fb95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82bf0c0-c8ee-473e-a327-4680390fbda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82bf0c0-c8ee-473e-a327-4680390fbda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6907bd9-9952-4552-bd76-c28021e2f667', 'volume_name': 'volume-a6907bd9-9952-4552-bd76-c28021e2f667', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b87473-881c-4174-ace1-17c4cb5e36b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b87473-881c-4174-ace1-17c4cb5e36b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb17c07b-5de4-49d7-94c7-93d86ed5fe1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:24 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Volume a6907bd9-9952-4552-bd76-c28021e2f667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6907bd9-9952-4552-bd76-c28021e2f667', 'volume_size': 1} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=76674b43-973e-4cb1-b591-6022a464ff2d,created_at=2026-07-06T10:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-602736983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76674b43-973e-4cb1-b591-6022a464ff2d,host='devstack@QuobyteHD#QuobyteHD',id=a6907bd9-9952-4552-bd76-c28021e2f667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aebfcb21abe34d10a1de3765da086f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:25Z,use_quota=True,user_id='71cdfd826dff47d091093b9cafb88692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a34b9ef-79eb-4188-9100-a99f92dba058),volume_type_id=3a34b9ef-79eb-4188-9100-a99f92dba058)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Creating volume a6907bd9-9952-4552-bd76-c28021e2f667 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:19:24 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Acquiring lock "cinder-781048ba-8dc1-4248-8a2b-bf7044194d95-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:24 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667 1073741824 Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Lock "cinder-781048ba-8dc1-4248-8a2b-bf7044194d95-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:24 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Acquiring lock "cinder-quobyte-781048ba-8dc1-4248-8a2b-bf7044194d95" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Lock "cinder-quobyte-781048ba-8dc1-4248-8a2b-bf7044194d95" acquired by "delete_volume" :: waited 0.014s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[b976c5b8-b71d-44f7-9ead-762c3a66a234]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-781048ba-8dc1-4248-8a2b-bf7044194d95 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:25 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-781048ba-8dc1-4248-8a2b-bf7044194d95 Jul 06 12:19:25 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:25 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667 1073741824" returned: 0 in 0.876s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:25 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667 Jul 06 12:19:25 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:25 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-781048ba-8dc1-4248-8a2b-bf7044194d95" returned: 0 in 0.872s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-781048ba-8dc1-4248-8a2b-bf7044194d95 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:25 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-781048ba-8dc1-4248-8a2b-bf7044194d95 Jul 06 12:19:25 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:26 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667" returned: 0 in 0.709s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb17c07b-5de4-49d7-94c7-93d86ed5fe1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6907bd9-9952-4552-bd76-c28021e2f667', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632ff123-d4b3-452f-b097-fb054d466de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:26 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Volume volume-a6907bd9-9952-4552-bd76-c28021e2f667 (a6907bd9-9952-4552-bd76-c28021e2f667): created successfully Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632ff123-d4b3-452f-b097-fb054d466de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Flow 'volume_create_manager' (3e6e5e2b-c504-4aa1-9cc8-d3f15d063c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:26 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-781048ba-8dc1-4248-8a2b-bf7044194d95" returned: 0 in 0.711s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:26 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-decd728c-7ad3-44dc-a874-f8418db73069 tempest-GroupSnapshotsTest-1727086509 None] Created volume successfully. Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Lock "cinder-quobyte-781048ba-8dc1-4248-8a2b-bf7044194d95" released by "delete_volume" :: held 1.644s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Created reservations ['5f196f92-f323-4dc9-9c73-9b54a84721a7', 'bb383bed-cbc4-437b-9b7a-cf261d0449e0', '0945253d-0e52-4365-ad3c-e9b9fccbf02d', '3d45b9fc-09da-47db-9f0e-cd9fcfc0f55e'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:26 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:19:26 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:27 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] GroupSnapshot c57ed878-ea01-449b-abe3-040fa81da92d: creating. Jul 06 12:19:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] Group snapshot c57ed878-ea01-449b-abe3-040fa81da92d: creating. {{(pid=86761) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 12:19:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] Creating offline snapshot b68b5ffe-2553-447c-a0c2-47fbef46f15b of volume a6907bd9-9952-4552-bd76-c28021e2f667 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:19:27 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.751s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:27 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:19:27 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Deleted volume successfully. Jul 06 12:19:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e30aa66e-0b03-4e53-a580-cc0bc3bceacf tempest-VolumesActionsTest-371870880 None] Lock "cinder-781048ba-8dc1-4248-8a2b-bf7044194d95-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:27 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dee1d23-f243-40f3-99e2-44e326b23a6b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:27 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667 Jul 06 12:19:27 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:28 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667" returned: 0 in 0.830s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:28 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b 1G Jul 06 12:19:28 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:29 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b 1G" returned: 0 in 0.972s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6907bd9-9952-4552-bd76-c28021e2f667 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:29 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6907bd9-9952-4552-bd76-c28021e2f667 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b Jul 06 12:19:29 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:30 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6907bd9-9952-4552-bd76-c28021e2f667 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b" returned: 0 in 0.912s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:30 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:19:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:30 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b Jul 06 12:19:30 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:30 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b" returned: 0 in 0.740s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:30 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.info Jul 06 12:19:30 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:31 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.info" returned: 0 in 0.715s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:31 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:19:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:31 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.info Jul 06 12:19:31 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:32 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.info" returned: 0 in 0.748s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.036s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:32 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f2a1b37a-e577-4c70-96a1-8f572202c5a9 tempest-GroupSnapshotsTest-1727086509 None] group_snapshot c57ed878-ea01-449b-abe3-040fa81da92d: created successfully Jul 06 12:19:32 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] group_snapshot c57ed878-ea01-449b-abe3-040fa81da92d: deleting Jul 06 12:19:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] group_snapshot c57ed878-ea01-449b-abe3-040fa81da92d: deleting {{(pid=86761) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 12:19:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "cinder-quobyte-a6907bd9-9952-4552-bd76-c28021e2f667" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-a6907bd9-9952-4552-bd76-c28021e2f667" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "cinder-quobyte-b68b5ffe-2553-447c-a0c2-47fbef46f15b" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-b68b5ffe-2553-447c-a0c2-47fbef46f15b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] Deleting offline snapshot b68b5ffe-2553-447c-a0c2-47fbef46f15b of volume a6907bd9-9952-4552-bd76-c28021e2f667 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:19:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] snapshot_file for this snap is: volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:19:32 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[4063aeb0-18d9-4f3a-9135-49cb864833d0]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:32 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b Jul 06 12:19:32 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:33 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b" returned: 0 in 0.887s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6907bd9-9952-4552-bd76-c28021e2f667(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:19:33 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7572af-2f46-44bc-933d-781b7801f221]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:33 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667 Jul 06 12:19:33 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:34 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667" returned: 0 in 0.822s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:34 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b Jul 06 12:19:34 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Flow 'volume_create_manager' (e8c7ca64-1da0-4967-8a0f-60c922bb0570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa89b86-638e-4535-a0c7-5dd98bd694e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa89b86-638e-4535-a0c7-5dd98bd694e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-664229021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a80d8e-3f0d-410e-8cc3-a033cba831d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5478c009d3104cc1b989f49f6ebd49f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:35Z,use_quota=True,user_id='44be4a5a19da41eaaddb7a86b458d37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144732a5-df3a-4443-b5a1-9cf76713f6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144732a5-df3a-4443-b5a1-9cf76713f6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57771cd1-5adb-4fac-9fb4-cde0daebf09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57771cd1-5adb-4fac-9fb4-cde0daebf09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a80d8e-3f0d-410e-8cc3-a033cba831d3', 'volume_name': 'volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e14ef2-16c6-4831-bf86-6971fe7eef00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e14ef2-16c6-4831-bf86-6971fe7eef00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5522f422-9b0d-48fe-a031-561701bd718c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:35 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Volume 15a80d8e-3f0d-410e-8cc3-a033cba831d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3', 'volume_size': 1} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-664229021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a80d8e-3f0d-410e-8cc3-a033cba831d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5478c009d3104cc1b989f49f6ebd49f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:35Z,use_quota=True,user_id='44be4a5a19da41eaaddb7a86b458d37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Creating volume 15a80d8e-3f0d-410e-8cc3-a033cba831d3 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:19:35 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:35 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3 1073741824 Jul 06 12:19:35 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:35 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b" returned: 0 in 0.857s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:35 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b Jul 06 12:19:35 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:36 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667.b68b5ffe-2553-447c-a0c2-47fbef46f15b" returned: 0 in 0.743s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-b68b5ffe-2553-447c-a0c2-47fbef46f15b" released by "_delete_snapshot" :: held 3.414s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-a6907bd9-9952-4552-bd76-c28021e2f667" released by "delete_snapshot" :: held 3.438s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:36 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3 1073741824" returned: 0 in 0.902s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:36 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3 Jul 06 12:19:36 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:36 devstack cinder-volume[86761]: WARNING cinder.quota [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-841531425 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-841531425, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:19:36 devstack cinder-volume[86761]: WARNING cinder.quota [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-841531425 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-841531425, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:19:36 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] Created reservations ['3a92d2b2-c579-4412-b995-e9627e3b2fdb', 'f2b51fa8-bf17-4323-b26a-2bcb6241da53', '7a2cc54b-8b0b-4089-9fea-bebdd44ad5b3', '956a3c50-f9b5-4d3d-bf3b-7899faaae244'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:36 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-fc7238bd-7bcc-4c36-9e61-60b96320f8ca tempest-GroupSnapshotsTest-1727086509 None] group_snapshot c57ed878-ea01-449b-abe3-040fa81da92d: deleted successfully Jul 06 12:19:36 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3" returned: 0 in 0.686s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:19:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5522f422-9b0d-48fe-a031-561701bd718c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5347dc7a-bd0a-4fc0-ab08-435d127bbad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:37 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Volume volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3 (15a80d8e-3f0d-410e-8cc3-a033cba831d3): created successfully Jul 06 12:19:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5347dc7a-bd0a-4fc0-ab08-435d127bbad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Flow 'volume_create_manager' (e8c7ca64-1da0-4967-8a0f-60c922bb0570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:37 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-184cc64e-2707-4c13-a074-54f13f62200e tempest-VolumesActionsTest-371870880 None] Created volume successfully. Jul 06 12:19:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "cinder-quobyte-a6907bd9-9952-4552-bd76-c28021e2f667" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-a6907bd9-9952-4552-bd76-c28021e2f667" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:37 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4058d4-56c8-4978-a23e-aac74bccda99]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Acquiring lock "cinder-15a80d8e-3f0d-410e-8cc3-a033cba831d3-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Lock "cinder-15a80d8e-3f0d-410e-8cc3-a033cba831d3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Acquiring lock "cinder-quobyte-15a80d8e-3f0d-410e-8cc3-a033cba831d3" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:37 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667 Jul 06 12:19:37 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Lock "cinder-quobyte-15a80d8e-3f0d-410e-8cc3-a033cba831d3" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:37 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4808c7b-7f3c-4182-948b-da6b4233cd12]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:37 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3 Jul 06 12:19:37 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:38 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667" returned: 0 in 0.929s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:38 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667 Jul 06 12:19:38 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:38 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3" returned: 0 in 0.870s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:38 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3 Jul 06 12:19:38 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:39 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a6907bd9-9952-4552-bd76-c28021e2f667" returned: 0 in 0.805s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Lock "cinder-quobyte-a6907bd9-9952-4552-bd76-c28021e2f667" released by "delete_volume" :: held 1.827s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Created reservations ['a2059587-67a9-4c45-8f2b-375599e776fd'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:39 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-15a80d8e-3f0d-410e-8cc3-a033cba831d3" returned: 0 in 0.729s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Lock "cinder-quobyte-15a80d8e-3f0d-410e-8cc3-a033cba831d3" released by "delete_volume" :: held 1.649s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:39 devstack cinder-volume[86761]: WARNING cinder.quota [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-841531425 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-841531425, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Created reservations ['38b6c96d-b2a4-40dd-ac61-1a6118d32545', '5305e3a6-4a54-490f-bf0b-562ae21af9a4', '74e2c877-bd5c-4d3e-9c14-6f1c557d13b9', '6fd578f9-a03a-4c20-9bf4-068353e194f7'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Created reservations ['7ae557df-a864-4b37-b10a-2b3ecda55932', '7dbf731d-9d77-4777-a321-dcaf0864f095', 'f8052d73-9fc9-40fe-8389-9b1bd45842ae', '562162ab-d7ae-49b4-9bb3-5d194db20878'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:39 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:19:39 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:39 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:19:39 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:40 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.810s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:19:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Deleted volume successfully. Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa98462d-073c-4d2a-92de-99eba646caee tempest-VolumesActionsTest-1112924069 None] Lock "cinder-15a80d8e-3f0d-410e-8cc3-a033cba831d3-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:40 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.007s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:19:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-8a8d7063-62e6-4729-8b53-507f5eb11870 tempest-GroupSnapshotsTest-1727086509 None] Delete group completed successfully. Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Flow 'volume_create_manager' (c46028b0-134e-4af5-a56f-f7e81f8b70a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19311b71-ae49-4051-82cf-13fa7a371f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19311b71-ae49-4051-82cf-13fa7a371f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-222468937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13be6280-cbf5-491d-9417-97f7fb716537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5478c009d3104cc1b989f49f6ebd49f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:41Z,use_quota=True,user_id='44be4a5a19da41eaaddb7a86b458d37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2251f4ad-8629-4b3b-9030-4f2cfecc28a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2251f4ad-8629-4b3b-9030-4f2cfecc28a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138b77d1-32ab-4773-ab3a-d98160372ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138b77d1-32ab-4773-ab3a-d98160372ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13be6280-cbf5-491d-9417-97f7fb716537', 'volume_name': 'volume-13be6280-cbf5-491d-9417-97f7fb716537', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6170232b-218e-4070-95c5-529282ec0278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6170232b-218e-4070-95c5-529282ec0278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90a1d0f-9cd8-4a97-98dd-b45514fffd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:40 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Volume 13be6280-cbf5-491d-9417-97f7fb716537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13be6280-cbf5-491d-9417-97f7fb716537', 'volume_size': 1} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-222468937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13be6280-cbf5-491d-9417-97f7fb716537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5478c009d3104cc1b989f49f6ebd49f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:41Z,use_quota=True,user_id='44be4a5a19da41eaaddb7a86b458d37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Creating volume 13be6280-cbf5-491d-9417-97f7fb716537 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:19:40 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:19:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-13be6280-cbf5-491d-9417-97f7fb716537 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:40 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-13be6280-cbf5-491d-9417-97f7fb716537 1073741824 Jul 06 12:19:40 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:41 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-13be6280-cbf5-491d-9417-97f7fb716537 1073741824" returned: 0 in 1.101s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-13be6280-cbf5-491d-9417-97f7fb716537 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:42 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-13be6280-cbf5-491d-9417-97f7fb716537 Jul 06 12:19:42 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:42 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-13be6280-cbf5-491d-9417-97f7fb716537" returned: 0 in 0.807s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:19:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90a1d0f-9cd8-4a97-98dd-b45514fffd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13be6280-cbf5-491d-9417-97f7fb716537', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa000a10-8fb8-4d10-9455-558f0f488cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:42 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Volume volume-13be6280-cbf5-491d-9417-97f7fb716537 (13be6280-cbf5-491d-9417-97f7fb716537): created successfully Jul 06 12:19:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa000a10-8fb8-4d10-9455-558f0f488cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Flow 'volume_create_manager' (c46028b0-134e-4af5-a56f-f7e81f8b70a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:42 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-1879ec66-034b-401a-befa-40f166f524ab tempest-VolumesActionsTest-371870880 None] Created volume successfully. Jul 06 12:19:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Acquiring lock "cinder-13be6280-cbf5-491d-9417-97f7fb716537-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Lock "cinder-13be6280-cbf5-491d-9417-97f7fb716537-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Acquiring lock "cinder-quobyte-13be6280-cbf5-491d-9417-97f7fb716537" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Lock "cinder-quobyte-13be6280-cbf5-491d-9417-97f7fb716537" acquired by "delete_volume" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:44 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e641ed-c9b7-487a-b5dc-f98ccd62f80d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-13be6280-cbf5-491d-9417-97f7fb716537 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:44 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-13be6280-cbf5-491d-9417-97f7fb716537 Jul 06 12:19:44 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:45 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-13be6280-cbf5-491d-9417-97f7fb716537" returned: 0 in 0.825s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-13be6280-cbf5-491d-9417-97f7fb716537 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:45 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-13be6280-cbf5-491d-9417-97f7fb716537 Jul 06 12:19:45 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:45 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-13be6280-cbf5-491d-9417-97f7fb716537" returned: 0 in 0.739s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Lock "cinder-quobyte-13be6280-cbf5-491d-9417-97f7fb716537" released by "delete_volume" :: held 1.614s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:45 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Created reservations ['77237c75-1698-4bdc-8e7e-9743e5993046', '40648154-f575-40da-9742-2532978d92f2', '1847d289-d0a4-4785-9fc8-1f45f351d6a3', 'fed12cda-365d-4b07-9c13-77f973df99b6'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:46 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:19:46 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:46 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-878af7b4-214a-44ac-b088-dbf5ffdd8cea tempest-GroupSnapshotsV319Test-1047077307 None] Group tempest-GroupSnapshotsV319Test-Group-1291291765: creating Jul 06 12:19:46 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-878af7b4-214a-44ac-b088-dbf5ffdd8cea tempest-GroupSnapshotsV319Test-1047077307 None] Group tempest-GroupSnapshotsV319Test-Group-1291291765: created successfully Jul 06 12:19:46 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-878af7b4-214a-44ac-b088-dbf5ffdd8cea tempest-GroupSnapshotsV319Test-1047077307 None] Create group completed successfully. Jul 06 12:19:46 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.681s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:19:46 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Deleted volume successfully. Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-379d1bdc-b90f-4fa3-a3b1-f069355e1e6e tempest-VolumesActionsTest-1112924069 None] Lock "cinder-13be6280-cbf5-491d-9417-97f7fb716537-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Flow 'volume_create_manager' (9d278de0-ed76-4640-951d-d86547c99d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55591a7-f581-4ae9-b3b1-20d6cd5cca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55591a7-f581-4ae9-b3b1-20d6cd5cca70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-224059573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0de5aae-12f8-456c-8e70-56b63b965965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5478c009d3104cc1b989f49f6ebd49f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:47Z,use_quota=True,user_id='44be4a5a19da41eaaddb7a86b458d37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e2065f-a304-47c5-9c51-c22cac194097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e2065f-a304-47c5-9c51-c22cac194097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f958b3c1-c35e-4a68-9d8a-f7b1b16681d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f958b3c1-c35e-4a68-9d8a-f7b1b16681d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0de5aae-12f8-456c-8e70-56b63b965965', 'volume_name': 'volume-a0de5aae-12f8-456c-8e70-56b63b965965', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81953c7-80af-457f-8281-973014bd84be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81953c7-80af-457f-8281-973014bd84be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6bc294-6436-4391-b372-ed14d552638c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:46 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Volume a0de5aae-12f8-456c-8e70-56b63b965965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0de5aae-12f8-456c-8e70-56b63b965965', 'volume_size': 1} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-224059573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0de5aae-12f8-456c-8e70-56b63b965965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5478c009d3104cc1b989f49f6ebd49f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:47Z,use_quota=True,user_id='44be4a5a19da41eaaddb7a86b458d37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Creating volume a0de5aae-12f8-456c-8e70-56b63b965965 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:19:47 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:19:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a0de5aae-12f8-456c-8e70-56b63b965965 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:47 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a0de5aae-12f8-456c-8e70-56b63b965965 1073741824 Jul 06 12:19:47 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:47 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:19:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Flow 'volume_create_manager' (605b24db-af4c-4d6e-a05b-8f6fa73aed39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82186c5b-3435-4136-844e-006245f0a6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82186c5b-3435-4136-844e-006245f0a6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-714460437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9fc6d86-5d9e-4bde-b513-178eabc6ad42,host='devstack@QuobyteHD#QuobyteHD',id=aa66b9cb-56be-46a2-b99f-d78d630e14e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202206c6c4af445685d0061fdc2da1f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:48Z,use_quota=True,user_id='b316acbed4274343b074c0b0b5bc7547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bc573f3-9eb6-4121-bf77-ddb4843e264b),volume_type_id=0bc573f3-9eb6-4121-bf77-ddb4843e264b)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:48 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d7d5f2-b84e-435a-9ccb-7d0385a332cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d7d5f2-b84e-435a-9ccb-7d0385a332cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbffcd2b-4739-44cd-b3a6-2c83e72609f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbffcd2b-4739-44cd-b3a6-2c83e72609f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa66b9cb-56be-46a2-b99f-d78d630e14e7', 'volume_name': 'volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08342f61-deb3-409e-80d0-a1efe13df9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08342f61-deb3-409e-80d0-a1efe13df9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d56938-ebe0-4725-8c98-76f2581dc8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:48 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Volume aa66b9cb-56be-46a2-b99f-d78d630e14e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7', 'volume_size': 1} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a0de5aae-12f8-456c-8e70-56b63b965965 1073741824" returned: 0 in 1.042s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a0de5aae-12f8-456c-8e70-56b63b965965 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:48 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a0de5aae-12f8-456c-8e70-56b63b965965 Jul 06 12:19:48 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:48 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a0de5aae-12f8-456c-8e70-56b63b965965" returned: 0 in 0.690s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a9fc6d86-5d9e-4bde-b513-178eabc6ad42,created_at=2026-07-06T10:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-714460437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9fc6d86-5d9e-4bde-b513-178eabc6ad42,host='devstack@QuobyteHD#QuobyteHD',id=aa66b9cb-56be-46a2-b99f-d78d630e14e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202206c6c4af445685d0061fdc2da1f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:48Z,use_quota=True,user_id='b316acbed4274343b074c0b0b5bc7547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bc573f3-9eb6-4121-bf77-ddb4843e264b),volume_type_id=0bc573f3-9eb6-4121-bf77-ddb4843e264b)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Creating volume aa66b9cb-56be-46a2-b99f-d78d630e14e7 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:19:48 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:48 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 1073741824 Jul 06 12:19:48 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6bc294-6436-4391-b372-ed14d552638c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0de5aae-12f8-456c-8e70-56b63b965965', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfbce94-09ba-4d67-b98b-49bdb16e1054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:48 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Volume volume-a0de5aae-12f8-456c-8e70-56b63b965965 (a0de5aae-12f8-456c-8e70-56b63b965965): created successfully Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfbce94-09ba-4d67-b98b-49bdb16e1054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:48 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Flow 'volume_create_manager' (9d278de0-ed76-4640-951d-d86547c99d41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:48 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-9f24e59e-7dd0-4aaa-b3d2-6a81880d9a69 tempest-VolumesActionsTest-371870880 None] Created volume successfully. Jul 06 12:19:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Acquiring lock "cinder-a0de5aae-12f8-456c-8e70-56b63b965965-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Lock "cinder-a0de5aae-12f8-456c-8e70-56b63b965965-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Acquiring lock "cinder-quobyte-a0de5aae-12f8-456c-8e70-56b63b965965" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Lock "cinder-quobyte-a0de5aae-12f8-456c-8e70-56b63b965965" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:49 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df522d2-b646-413f-a9e9-3a8c9d665181]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a0de5aae-12f8-456c-8e70-56b63b965965 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:49 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a0de5aae-12f8-456c-8e70-56b63b965965 Jul 06 12:19:49 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:49 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 1073741824" returned: 0 in 0.923s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:49 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 Jul 06 12:19:49 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:50 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a0de5aae-12f8-456c-8e70-56b63b965965" returned: 0 in 0.916s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a0de5aae-12f8-456c-8e70-56b63b965965 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:50 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a0de5aae-12f8-456c-8e70-56b63b965965 Jul 06 12:19:50 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:50 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7" returned: 0 in 0.786s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:19:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d56938-ebe0-4725-8c98-76f2581dc8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e30b1b6-a257-471b-81ff-0099dee73f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:50 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Volume volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 (aa66b9cb-56be-46a2-b99f-d78d630e14e7): created successfully Jul 06 12:19:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e30b1b6-a257-471b-81ff-0099dee73f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Flow 'volume_create_manager' (605b24db-af4c-4d6e-a05b-8f6fa73aed39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:50 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-68958cd9-76ff-4993-95cf-5a85b5b21f2e tempest-GroupSnapshotsV319Test-1047077307 None] Created volume successfully. Jul 06 12:19:51 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a0de5aae-12f8-456c-8e70-56b63b965965" returned: 0 in 0.817s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Lock "cinder-quobyte-a0de5aae-12f8-456c-8e70-56b63b965965" released by "delete_volume" :: held 1.773s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:51 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Created reservations ['af6c9b0c-030c-427d-9e0c-c36a2d5ac27d', '29e61357-1969-48ef-ac63-bd6f7f57459d', 'd721ea23-55fd-4dae-a799-b807b4472fe1', 'ff22ad84-48cc-4a2a-b850-73ac11fbd787'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:51 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:51 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:51 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:19:51 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] GroupSnapshot 5bfa0a5c-c53a-4caf-9248-eb54fd18d00c: creating. Jul 06 12:19:51 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=111,cinder:SELECT=94,cinder:INSERT=29,cinder:DELETE=5 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:19:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] Group snapshot 5bfa0a5c-c53a-4caf-9248-eb54fd18d00c: creating. {{(pid=86761) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 12:19:51 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.741s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:51 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] Creating offline snapshot 828532e2-c2cd-4cd8-bdb3-f3e672c4f313 of volume aa66b9cb-56be-46a2-b99f-d78d630e14e7 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:19:52 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Deleted volume successfully. Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea6ba3f-0183-4832-addf-182dbbdd089c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7955f8d0-1cce-42d0-894d-027c18a0dd11 tempest-VolumesActionsTest-1112924069 None] Lock "cinder-a0de5aae-12f8-456c-8e70-56b63b965965-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:52 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 Jul 06 12:19:52 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Flow 'volume_create_manager' (7258aff9-3f7f-4d7e-8363-e67944ff990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7584b858-f07b-45a1-ab73-6d5006ed5494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7584b858-f07b-45a1-ab73-6d5006ed5494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2021072276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b3f287-98a1-4353-92e2-48e9bba4fe7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5478c009d3104cc1b989f49f6ebd49f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:52Z,use_quota=True,user_id='44be4a5a19da41eaaddb7a86b458d37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac02c873-d45f-4068-9aff-b4fbfa974b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac02c873-d45f-4068-9aff-b4fbfa974b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f3b611-e6a0-409e-b6d5-18717e14aad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f3b611-e6a0-409e-b6d5-18717e14aad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b3f287-98a1-4353-92e2-48e9bba4fe7f', 'volume_name': 'volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a6c0aa-c381-4ec3-97f5-2b092cb18542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a6c0aa-c381-4ec3-97f5-2b092cb18542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de62e07-b7e0-4284-80b8-87a3ade7f886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:52 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Volume c2b3f287-98a1-4353-92e2-48e9bba4fe7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f', 'volume_size': 1} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:52 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:19:52 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:52 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7" returned: 0 in 0.855s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:52 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313 1G Jul 06 12:19:52 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:53 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.722s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:19:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:19:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:19:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:19:53 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313 1G" returned: 0 in 0.907s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:53 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313 Jul 06 12:19:53 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:54 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313" returned: 0 in 0.711s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:54 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:19:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:54 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313 Jul 06 12:19:54 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:55 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313" returned: 0 in 0.667s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:55 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.info Jul 06 12:19:55 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:55 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.info" returned: 0 in 0.681s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:55 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:19:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:55 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.info Jul 06 12:19:55 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:56 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.info" returned: 0 in 0.667s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.612s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.298s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2021072276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b3f287-98a1-4353-92e2-48e9bba4fe7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5478c009d3104cc1b989f49f6ebd49f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:52Z,use_quota=True,user_id='44be4a5a19da41eaaddb7a86b458d37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:19:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Creating volume c2b3f287-98a1-4353-92e2-48e9bba4fe7f {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:19:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:19:56 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:19:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:56 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f 1073741824 Jul 06 12:19:56 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:56 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c08ff180-c070-4f1c-a6d4-76973a3150fe tempest-GroupSnapshotsV319Test-1047077307 None] group_snapshot 5bfa0a5c-c53a-4caf-9248-eb54fd18d00c: created successfully Jul 06 12:19:57 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f 1073741824" returned: 0 in 0.940s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:57 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=107,cinder:UPDATE=111,cinder:INSERT=24,cinder:DELETE=5 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:19:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:57 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f Jul 06 12:19:57 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:57 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] group_snapshot 5bfa0a5c-c53a-4caf-9248-eb54fd18d00c: deleting Jul 06 12:19:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] group_snapshot 5bfa0a5c-c53a-4caf-9248-eb54fd18d00c: deleting {{(pid=86761) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 12:19:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] Acquiring lock "cinder-quobyte-aa66b9cb-56be-46a2-b99f-d78d630e14e7" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] Lock "cinder-quobyte-aa66b9cb-56be-46a2-b99f-d78d630e14e7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] Acquiring lock "cinder-quobyte-828532e2-c2cd-4cd8-bdb3-f3e672c4f313" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] Lock "cinder-quobyte-828532e2-c2cd-4cd8-bdb3-f3e672c4f313" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] Deleting offline snapshot 828532e2-c2cd-4cd8-bdb3-f3e672c4f313 of volume aa66b9cb-56be-46a2-b99f-d78d630e14e7 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:19:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] snapshot_file for this snap is: volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:19:57 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[5affa864-06ed-416c-bb30-35753812498d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:57 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313 Jul 06 12:19:57 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:58 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f" returned: 0 in 0.703s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de62e07-b7e0-4284-80b8-87a3ade7f886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640d4ed8-ea15-4265-bdff-937d27a350d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:58 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Volume volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f (c2b3f287-98a1-4353-92e2-48e9bba4fe7f): created successfully Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640d4ed8-ea15-4265-bdff-937d27a350d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Flow 'volume_create_manager' (7258aff9-3f7f-4d7e-8363-e67944ff990c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:58 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-00fb46a3-d0dc-4ea3-9868-44ef26098252 tempest-VolumesActionsTest-371870880 None] Created volume successfully. Jul 06 12:19:58 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313" returned: 0 in 0.828s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[4777f1d0-d67f-4887-b3c5-c0ae934613f7]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Acquiring lock "cinder-c2b3f287-98a1-4353-92e2-48e9bba4fe7f-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Lock "cinder-c2b3f287-98a1-4353-92e2-48e9bba4fe7f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:58 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 Jul 06 12:19:58 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Acquiring lock "cinder-quobyte-c2b3f287-98a1-4353-92e2-48e9bba4fe7f" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Lock "cinder-quobyte-c2b3f287-98a1-4353-92e2-48e9bba4fe7f" acquired by "delete_volume" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[81042a6f-d092-4b48-a728-7051dc39f5fc]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:59 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f Jul 06 12:19:59 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:59 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7" returned: 0 in 0.833s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:59 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313 Jul 06 12:19:59 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:59 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f" returned: 0 in 0.802s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:59 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f Jul 06 12:19:59 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:00 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313" returned: 0 in 0.771s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:00 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313 Jul 06 12:20:00 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:00 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c2b3f287-98a1-4353-92e2-48e9bba4fe7f" returned: 0 in 0.672s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Lock "cinder-quobyte-c2b3f287-98a1-4353-92e2-48e9bba4fe7f" released by "delete_volume" :: held 1.517s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:00 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Created reservations ['b4aabe87-5d59-4996-8eb0-4e336487a981', '252fdfa9-6e5f-403d-b2e8-1445c9f5625d', '633fa947-5b9c-41f4-8c30-cec8bce9b95d', '0e83ade9-0f5d-4e93-9814-dd7891b475c8'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:00 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:20:00 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:01 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7.828532e2-c2cd-4cd8-bdb3-f3e672c4f313" returned: 0 in 0.743s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] Lock "cinder-quobyte-828532e2-c2cd-4cd8-bdb3-f3e672c4f313" released by "_delete_snapshot" :: held 3.320s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] Lock "cinder-quobyte-aa66b9cb-56be-46a2-b99f-d78d630e14e7" released by "delete_snapshot" :: held 3.347s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:01 devstack cinder-volume[86761]: WARNING cinder.quota [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1627332631 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1627332631, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:20:01 devstack cinder-volume[86761]: WARNING cinder.quota [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1627332631 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1627332631, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] Created reservations ['36d9326f-769e-4cd9-8d23-5e6eff820472', 'b0e8d540-8d83-49aa-9dfc-0b370d8918c9', '0aa852fb-2673-4960-92bd-4fbb66645db2', 'e89700e9-13da-4775-8e20-28802dd7d145'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:01 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.740s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:01 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Deleted volume successfully. Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-718a18c5-1eea-40fb-b6ef-ab2eda52b99b tempest-VolumesActionsTest-1112924069 None] Lock "cinder-c2b3f287-98a1-4353-92e2-48e9bba4fe7f-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:01 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4c0dc040-0c20-43f0-bdd8-fc79c5a832b2 tempest-GroupSnapshotsV319Test-1047077307 None] group_snapshot 5bfa0a5c-c53a-4caf-9248-eb54fd18d00c: deleted successfully Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Flow 'volume_create_manager' (28229567-3114-4e7c-903d-91a2adeb6a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1890074b-36f0-4328-aba8-88d8739081e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1890074b-36f0-4328-aba8-88d8739081e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1186579632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c61664-2ed0-4505-82d0-73654fe4ed61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5478c009d3104cc1b989f49f6ebd49f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:02Z,use_quota=True,user_id='44be4a5a19da41eaaddb7a86b458d37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424cf294-8958-46d8-88a3-6dcd7ab26a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424cf294-8958-46d8-88a3-6dcd7ab26a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc23da07-0566-406a-b438-c46f6b59671b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc23da07-0566-406a-b438-c46f6b59671b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c61664-2ed0-4505-82d0-73654fe4ed61', 'volume_name': 'volume-c4c61664-2ed0-4505-82d0-73654fe4ed61', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344c65b9-3991-453b-9d63-46f7fa223e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344c65b9-3991-453b-9d63-46f7fa223e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67412cc8-f89e-4de4-93d7-e894e89ba8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:01 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Volume c4c61664-2ed0-4505-82d0-73654fe4ed61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c61664-2ed0-4505-82d0-73654fe4ed61', 'volume_size': 1} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1186579632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c61664-2ed0-4505-82d0-73654fe4ed61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5478c009d3104cc1b989f49f6ebd49f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:02Z,use_quota=True,user_id='44be4a5a19da41eaaddb7a86b458d37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Creating volume c4c61664-2ed0-4505-82d0-73654fe4ed61 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:01 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:20:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4c61664-2ed0-4505-82d0-73654fe4ed61 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:01 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4c61664-2ed0-4505-82d0-73654fe4ed61 1073741824 Jul 06 12:20:01 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Acquiring lock "cinder-quobyte-aa66b9cb-56be-46a2-b99f-d78d630e14e7" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Lock "cinder-quobyte-aa66b9cb-56be-46a2-b99f-d78d630e14e7" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:02 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3ea0b0-f13f-4b25-9511-5ea3063e34f6]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:02 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 Jul 06 12:20:02 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:02 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4c61664-2ed0-4505-82d0-73654fe4ed61 1073741824" returned: 0 in 0.922s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4c61664-2ed0-4505-82d0-73654fe4ed61 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:02 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4c61664-2ed0-4505-82d0-73654fe4ed61 Jul 06 12:20:02 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:03 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7" returned: 0 in 0.829s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:03 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7 Jul 06 12:20:03 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:03 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4c61664-2ed0-4505-82d0-73654fe4ed61" returned: 0 in 0.726s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67412cc8-f89e-4de4-93d7-e894e89ba8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c61664-2ed0-4505-82d0-73654fe4ed61', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f902c9-a7fc-4169-a0df-5c828abf20c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:03 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Volume volume-c4c61664-2ed0-4505-82d0-73654fe4ed61 (c4c61664-2ed0-4505-82d0-73654fe4ed61): created successfully Jul 06 12:20:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f902c9-a7fc-4169-a0df-5c828abf20c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Flow 'volume_create_manager' (28229567-3114-4e7c-903d-91a2adeb6a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:03 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0bf333a5-2e37-44df-9c86-6acd28146f8e tempest-VolumesActionsTest-371870880 None] Created volume successfully. Jul 06 12:20:04 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa66b9cb-56be-46a2-b99f-d78d630e14e7" returned: 0 in 0.759s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Lock "cinder-quobyte-aa66b9cb-56be-46a2-b99f-d78d630e14e7" released by "delete_volume" :: held 1.656s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Created reservations ['3f633503-ac47-4031-8732-f04384c0d311'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:04 devstack cinder-volume[86761]: WARNING cinder.quota [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1627332631 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1627332631, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Created reservations ['c3cca925-518b-42a2-a7ce-76c8b9fc2c44', '4d5e365a-f683-43a8-b710-7a0d611dc514', '1029efcb-f70b-4e11-87f8-85a36b7f9725', '63678f3a-9198-4e31-bd21-f8f62c9b25c7'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Acquiring lock "cinder-c4c61664-2ed0-4505-82d0-73654fe4ed61-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:04 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:20:04 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Lock "cinder-c4c61664-2ed0-4505-82d0-73654fe4ed61-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Acquiring lock "cinder-quobyte-c4c61664-2ed0-4505-82d0-73654fe4ed61" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Lock "cinder-quobyte-c4c61664-2ed0-4505-82d0-73654fe4ed61" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeeea96f-ae3d-477c-b557-92974d698427]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4c61664-2ed0-4505-82d0-73654fe4ed61 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:04 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4c61664-2ed0-4505-82d0-73654fe4ed61 Jul 06 12:20:04 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:05 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.722s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:05 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:05 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2dd7312f-f345-492f-8593-64df39d9fd22 tempest-GroupSnapshotsV319Test-1047077307 None] Delete group completed successfully. Jul 06 12:20:05 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4c61664-2ed0-4505-82d0-73654fe4ed61" returned: 0 in 0.852s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4c61664-2ed0-4505-82d0-73654fe4ed61 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:05 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4c61664-2ed0-4505-82d0-73654fe4ed61 Jul 06 12:20:05 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:05 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4c61664-2ed0-4505-82d0-73654fe4ed61" returned: 0 in 0.717s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Lock "cinder-quobyte-c4c61664-2ed0-4505-82d0-73654fe4ed61" released by "delete_volume" :: held 1.613s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:06 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Created reservations ['8020a805-def4-4ced-98e3-c6af6209307d', '230ad89f-f34d-42b1-8e9d-5728ad93e837', 'b160afbb-017b-4af9-b7f2-5d7355b65c81', 'bcdecd12-9941-47af-b380-45994d5b8f0c'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:06 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:20:06 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:06 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.723s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:06 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:06 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Deleted volume successfully. Jul 06 12:20:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-480413bb-77e9-4b2d-80c4-05ad7e6ba124 tempest-VolumesActionsTest-371870880 None] Lock "cinder-c4c61664-2ed0-4505-82d0-73654fe4ed61-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:16 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=35,cinder:INSERT=11,cinder:UPDATE=43,cinder:DELETE=2 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:20:16 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=26,cinder:UPDATE=36,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:20:19 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Flow 'volume_create_manager' (a8b5930b-250f-4d63-88a5-82ebe701b2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ee1b24-eacd-4063-a700-c4260c2b475d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ee1b24-eacd-4063-a700-c4260c2b475d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-22920871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c37780c-6426-4b50-af38-361cd679e751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7eb7b1be14e47ad8c4f16d5da015b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:20Z,use_quota=True,user_id='81df1beca5b94df48bc429fa9fc0d902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa533534-9464-4385-abb0-7c1d07e93989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa533534-9464-4385-abb0-7c1d07e93989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac31668b-85b8-4254-a5b9-bdd3be385872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac31668b-85b8-4254-a5b9-bdd3be385872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c37780c-6426-4b50-af38-361cd679e751', 'volume_name': 'volume-6c37780c-6426-4b50-af38-361cd679e751', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1336700-1021-4de3-8d8c-c191df2f1717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1336700-1021-4de3-8d8c-c191df2f1717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0e4090-7327-4419-9fa3-85f0a6f60194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:20 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Volume 6c37780c-6426-4b50-af38-361cd679e751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c37780c-6426-4b50-af38-361cd679e751', 'volume_size': 1} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-22920871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c37780c-6426-4b50-af38-361cd679e751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7eb7b1be14e47ad8c4f16d5da015b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:20Z,use_quota=True,user_id='81df1beca5b94df48bc429fa9fc0d902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Creating volume 6c37780c-6426-4b50-af38-361cd679e751 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:20 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:20:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6c37780c-6426-4b50-af38-361cd679e751 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:20 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6c37780c-6426-4b50-af38-361cd679e751 1073741824 Jul 06 12:20:20 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:21 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Flow 'volume_create_manager' (27fc56a1-abc7-48a3-b4d6-1b57a5837562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f04460-1853-4fd1-9ba6-75a4aa1739a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6c37780c-6426-4b50-af38-361cd679e751 1073741824" returned: 0 in 1.002s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f04460-1853-4fd1-9ba6-75a4aa1739a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1328025153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d6bee9-23a4-45c1-9dff-820ed50570dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96cdd0be64394661bcc5d9d9fb31f224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:21Z,use_quota=True,user_id='711dc58ddb7e407486f9f96ddbdee8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b75674-85aa-4a3a-bcf3-6f43fb4777e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b75674-85aa-4a3a-bcf3-6f43fb4777e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8065f040-e491-4554-aa98-edeeed54801b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8065f040-e491-4554-aa98-edeeed54801b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d6bee9-23a4-45c1-9dff-820ed50570dc', 'volume_name': 'volume-49d6bee9-23a4-45c1-9dff-820ed50570dc', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ac1371-396b-484a-bf24-393536d0b2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ac1371-396b-484a-bf24-393536d0b2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bd34d3-41d9-4bac-90e7-5e857e0447a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:21 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Volume 49d6bee9-23a4-45c1-9dff-820ed50570dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d6bee9-23a4-45c1-9dff-820ed50570dc', 'volume_size': 1} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6c37780c-6426-4b50-af38-361cd679e751 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:21 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6c37780c-6426-4b50-af38-361cd679e751 Jul 06 12:20:21 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:21 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6c37780c-6426-4b50-af38-361cd679e751" returned: 0 in 0.656s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.699s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1328025153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d6bee9-23a4-45c1-9dff-820ed50570dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96cdd0be64394661bcc5d9d9fb31f224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:21Z,use_quota=True,user_id='711dc58ddb7e407486f9f96ddbdee8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Creating volume 49d6bee9-23a4-45c1-9dff-820ed50570dc {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:21 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49d6bee9-23a4-45c1-9dff-820ed50570dc 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0e4090-7327-4419-9fa3-85f0a6f60194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c37780c-6426-4b50-af38-361cd679e751', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:21 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49d6bee9-23a4-45c1-9dff-820ed50570dc 1073741824 Jul 06 12:20:21 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3a7866-b831-4f92-b8e9-0ec13891e070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:21 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Volume volume-6c37780c-6426-4b50-af38-361cd679e751 (6c37780c-6426-4b50-af38-361cd679e751): created successfully Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3a7866-b831-4f92-b8e9-0ec13891e070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Flow 'volume_create_manager' (a8b5930b-250f-4d63-88a5-82ebe701b2a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:21 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-5da29213-efb7-4d51-86c6-ccf68bbbc1ec tempest-VolumesListAdminTestJSON-977198901 None] Created volume successfully. Jul 06 12:20:22 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Flow 'volume_create_manager' (5d1f8b57-502d-4a3c-bf2c-dabc98ce511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a69f98-c18c-4c48-92d3-206da7da2f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a69f98-c18c-4c48-92d3-206da7da2f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1676082284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5d0a39-3fed-4667-84ce-83985fcc4f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7eb7b1be14e47ad8c4f16d5da015b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:23Z,use_quota=True,user_id='81df1beca5b94df48bc429fa9fc0d902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f5ea1a-1899-4342-b11f-1c59946f65e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f5ea1a-1899-4342-b11f-1c59946f65e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23922f7f-5064-40d9-b5c6-04df161060cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23922f7f-5064-40d9-b5c6-04df161060cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c5d0a39-3fed-4667-84ce-83985fcc4f0d', 'volume_name': 'volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1469cdd-dd62-41b8-8e8a-4a899a20b31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1469cdd-dd62-41b8-8e8a-4a899a20b31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe83d6f-5ea0-44ee-a916-045e7673684b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:22 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Volume 8c5d0a39-3fed-4667-84ce-83985fcc4f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d', 'volume_size': 1} Jul 06 12:20:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:22 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49d6bee9-23a4-45c1-9dff-820ed50570dc 1073741824" returned: 0 in 0.936s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49d6bee9-23a4-45c1-9dff-820ed50570dc {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:22 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49d6bee9-23a4-45c1-9dff-820ed50570dc Jul 06 12:20:22 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:23 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49d6bee9-23a4-45c1-9dff-820ed50570dc" returned: 0 in 0.664s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.752s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1676082284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5d0a39-3fed-4667-84ce-83985fcc4f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7eb7b1be14e47ad8c4f16d5da015b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:23Z,use_quota=True,user_id='81df1beca5b94df48bc429fa9fc0d902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Creating volume 8c5d0a39-3fed-4667-84ce-83985fcc4f0d {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:23 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:23 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d 1073741824 Jul 06 12:20:23 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bd34d3-41d9-4bac-90e7-5e857e0447a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d6bee9-23a4-45c1-9dff-820ed50570dc', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c20822-ed27-4384-93c6-a9776feca727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:23 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Volume volume-49d6bee9-23a4-45c1-9dff-820ed50570dc (49d6bee9-23a4-45c1-9dff-820ed50570dc): created successfully Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c20822-ed27-4384-93c6-a9776feca727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Flow 'volume_create_manager' (27fc56a1-abc7-48a3-b4d6-1b57a5837562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:23 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ee421f15-f8b3-43ed-91b2-c1a5ea86d9fb tempest-VolumesServicesTestJSON-572383909 None] Created volume successfully. Jul 06 12:20:24 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Acquiring lock "cinder-49d6bee9-23a4-45c1-9dff-820ed50570dc-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d 1073741824" returned: 0 in 0.862s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Lock "cinder-49d6bee9-23a4-45c1-9dff-820ed50570dc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:24 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d Jul 06 12:20:24 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Acquiring lock "cinder-quobyte-49d6bee9-23a4-45c1-9dff-820ed50570dc" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Lock "cinder-quobyte-49d6bee9-23a4-45c1-9dff-820ed50570dc" acquired by "delete_volume" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:24 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4395d9-0766-4479-903d-f6468c888753]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49d6bee9-23a4-45c1-9dff-820ed50570dc {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:24 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49d6bee9-23a4-45c1-9dff-820ed50570dc Jul 06 12:20:24 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:25 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d" returned: 0 in 0.648s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe83d6f-5ea0-44ee-a916-045e7673684b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba88cc5d-3cb1-4651-a636-a97a23227c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:25 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Volume volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d (8c5d0a39-3fed-4667-84ce-83985fcc4f0d): created successfully Jul 06 12:20:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba88cc5d-3cb1-4651-a636-a97a23227c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Flow 'volume_create_manager' (5d1f8b57-502d-4a3c-bf2c-dabc98ce511e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:25 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-55b842e4-b3bd-413d-97bf-0ef60fcba2ec tempest-VolumesListAdminTestJSON-977198901 None] Created volume successfully. Jul 06 12:20:25 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49d6bee9-23a4-45c1-9dff-820ed50570dc" returned: 0 in 0.809s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49d6bee9-23a4-45c1-9dff-820ed50570dc {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:25 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49d6bee9-23a4-45c1-9dff-820ed50570dc Jul 06 12:20:25 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:25 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49d6bee9-23a4-45c1-9dff-820ed50570dc" returned: 0 in 0.663s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:25 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Lock "cinder-quobyte-49d6bee9-23a4-45c1-9dff-820ed50570dc" released by "delete_volume" :: held 1.518s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Created reservations ['1af43468-2a64-4ec7-979c-332ee27b1c09', '8c967105-34d8-4b84-8f51-73c178936331', '97f7555b-eee0-47fb-b104-4eb514af3e43', '8d48a281-c69c-4bad-988a-fd60977c5999'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:26 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:20:26 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Flow 'volume_create_manager' (65707df4-3986-491b-87de-2e1ff8f17f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ab3af8-6ebb-49c9-90d1-cbfe0362d925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ab3af8-6ebb-49c9-90d1-cbfe0362d925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-486897953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6d5e59-dc74-4241-91d5-f710f1743a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7eb7b1be14e47ad8c4f16d5da015b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:26Z,use_quota=True,user_id='81df1beca5b94df48bc429fa9fc0d902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83185e22-13aa-4ffb-be01-0f22116a4fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83185e22-13aa-4ffb-be01-0f22116a4fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ad2bd1-8b11-47ca-83dc-3cca9725570c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ad2bd1-8b11-47ca-83dc-3cca9725570c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e6d5e59-dc74-4241-91d5-f710f1743a04', 'volume_name': 'volume-8e6d5e59-dc74-4241-91d5-f710f1743a04', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7ae180-3d34-42dc-9e4a-5f525ee35dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7ae180-3d34-42dc-9e4a-5f525ee35dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515832d5-b0b8-47fc-9209-a43e0f2e4fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:26 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Volume 8e6d5e59-dc74-4241-91d5-f710f1743a04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e6d5e59-dc74-4241-91d5-f710f1743a04', 'volume_size': 1} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-486897953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6d5e59-dc74-4241-91d5-f710f1743a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7eb7b1be14e47ad8c4f16d5da015b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:26Z,use_quota=True,user_id='81df1beca5b94df48bc429fa9fc0d902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Creating volume 8e6d5e59-dc74-4241-91d5-f710f1743a04 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:26 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8e6d5e59-dc74-4241-91d5-f710f1743a04 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:26 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8e6d5e59-dc74-4241-91d5-f710f1743a04 1073741824 Jul 06 12:20:26 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:26 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.722s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:26 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Deleted volume successfully. Jul 06 12:20:26 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-21d1990d-a89d-444a-98f4-2a5d8d32285c tempest-VolumesServicesTestJSON-572383909 None] Lock "cinder-49d6bee9-23a4-45c1-9dff-820ed50570dc-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:27 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8e6d5e59-dc74-4241-91d5-f710f1743a04 1073741824" returned: 0 in 0.916s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8e6d5e59-dc74-4241-91d5-f710f1743a04 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:27 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8e6d5e59-dc74-4241-91d5-f710f1743a04 Jul 06 12:20:27 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:28 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8e6d5e59-dc74-4241-91d5-f710f1743a04" returned: 0 in 0.755s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515832d5-b0b8-47fc-9209-a43e0f2e4fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6d5e59-dc74-4241-91d5-f710f1743a04', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fb85e2-7293-4856-925c-13e7b25c89d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:28 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Volume volume-8e6d5e59-dc74-4241-91d5-f710f1743a04 (8e6d5e59-dc74-4241-91d5-f710f1743a04): created successfully Jul 06 12:20:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fb85e2-7293-4856-925c-13e7b25c89d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Flow 'volume_create_manager' (65707df4-3986-491b-87de-2e1ff8f17f06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:28 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-e5fbf3f3-70a7-40c5-995e-53913e21c1a4 tempest-VolumesListAdminTestJSON-977198901 None] Created volume successfully. Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Flow 'volume_create_manager' (c6b24ee8-fbaf-49f6-89d9-cbf0c73d7151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8087131c-65f9-482e-8f10-e55021c32f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8087131c-65f9-482e-8f10-e55021c32f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c87370c-ef0e-4825-9dd4-a8579979d82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='103b01eb7a804f18bd1103e98f4edacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:30Z,use_quota=True,user_id='bc4679d3263147fa8a78ef4d6ee90855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e7ef3f-dc76-40db-929a-2715da761aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e7ef3f-dc76-40db-929a-2715da761aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb4551b-4599-4f93-a189-368454084833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb4551b-4599-4f93-a189-368454084833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c87370c-ef0e-4825-9dd4-a8579979d82d', 'volume_name': 'volume-5c87370c-ef0e-4825-9dd4-a8579979d82d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30c99e1-741c-47a9-ad25-e466283f6862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30c99e1-741c-47a9-ad25-e466283f6862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445eec35-6b39-4079-8b15-89d2f6fac3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:29 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Volume 5c87370c-ef0e-4825-9dd4-a8579979d82d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c87370c-ef0e-4825-9dd4-a8579979d82d', 'volume_size': 1} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c87370c-ef0e-4825-9dd4-a8579979d82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='103b01eb7a804f18bd1103e98f4edacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:30Z,use_quota=True,user_id='bc4679d3263147fa8a78ef4d6ee90855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Creating volume 5c87370c-ef0e-4825-9dd4-a8579979d82d {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:29 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:20:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5c87370c-ef0e-4825-9dd4-a8579979d82d 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:29 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5c87370c-ef0e-4825-9dd4-a8579979d82d 1073741824 Jul 06 12:20:29 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:30 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5c87370c-ef0e-4825-9dd4-a8579979d82d 1073741824" returned: 0 in 0.905s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5c87370c-ef0e-4825-9dd4-a8579979d82d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:30 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5c87370c-ef0e-4825-9dd4-a8579979d82d Jul 06 12:20:30 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:31 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5c87370c-ef0e-4825-9dd4-a8579979d82d" returned: 0 in 0.680s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445eec35-6b39-4079-8b15-89d2f6fac3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c87370c-ef0e-4825-9dd4-a8579979d82d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4935cc9c-d44d-47c9-86c3-166f1e87c3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:31 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Volume volume-5c87370c-ef0e-4825-9dd4-a8579979d82d (5c87370c-ef0e-4825-9dd4-a8579979d82d): created successfully Jul 06 12:20:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4935cc9c-d44d-47c9-86c3-166f1e87c3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Flow 'volume_create_manager' (c6b24ee8-fbaf-49f6-89d9-cbf0c73d7151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:31 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-59463884-fc79-4da6-ab8b-21d99f317401 tempest-VolumesListAdminTestJSON-1824642014 None] Created volume successfully. Jul 06 12:20:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Acquiring lock "cinder-5c87370c-ef0e-4825-9dd4-a8579979d82d-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Lock "cinder-5c87370c-ef0e-4825-9dd4-a8579979d82d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Acquiring lock "cinder-quobyte-5c87370c-ef0e-4825-9dd4-a8579979d82d" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Lock "cinder-quobyte-5c87370c-ef0e-4825-9dd4-a8579979d82d" acquired by "delete_volume" :: waited 0.027s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:33 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebe7213-24c0-47f2-80d9-bba967f6d896]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5c87370c-ef0e-4825-9dd4-a8579979d82d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Acquiring lock "cinder-8e6d5e59-dc74-4241-91d5-f710f1743a04-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Lock "cinder-8e6d5e59-dc74-4241-91d5-f710f1743a04-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:33 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5c87370c-ef0e-4825-9dd4-a8579979d82d Jul 06 12:20:33 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Acquiring lock "cinder-quobyte-8e6d5e59-dc74-4241-91d5-f710f1743a04" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Lock "cinder-quobyte-8e6d5e59-dc74-4241-91d5-f710f1743a04" acquired by "delete_volume" :: waited 0.015s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:33 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf91662-7e62-4e2b-896c-f393d67c5745]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8e6d5e59-dc74-4241-91d5-f710f1743a04 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:33 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8e6d5e59-dc74-4241-91d5-f710f1743a04 Jul 06 12:20:33 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:34 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5c87370c-ef0e-4825-9dd4-a8579979d82d" returned: 0 in 0.969s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5c87370c-ef0e-4825-9dd4-a8579979d82d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:34 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5c87370c-ef0e-4825-9dd4-a8579979d82d Jul 06 12:20:34 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:34 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8e6d5e59-dc74-4241-91d5-f710f1743a04" returned: 0 in 0.997s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8e6d5e59-dc74-4241-91d5-f710f1743a04 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:34 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8e6d5e59-dc74-4241-91d5-f710f1743a04 Jul 06 12:20:34 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:35 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5c87370c-ef0e-4825-9dd4-a8579979d82d" returned: 0 in 0.787s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Lock "cinder-quobyte-5c87370c-ef0e-4825-9dd4-a8579979d82d" released by "delete_volume" :: held 1.835s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Created reservations ['6746e7e5-1ed3-429e-968d-04a2510feea2', 'c1059b79-6e15-41d6-9609-b61b330b11c1', '134369ed-5790-4f9d-af3e-ca13436f2031', 'f83b9c06-e8af-433d-b2f7-79871ab42a50'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:35 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:20:35 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:35 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8e6d5e59-dc74-4241-91d5-f710f1743a04" returned: 0 in 0.850s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Lock "cinder-quobyte-8e6d5e59-dc74-4241-91d5-f710f1743a04" released by "delete_volume" :: held 1.907s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Created reservations ['4420a0f6-a985-445e-8955-f467670e2d7d', '89ee2ca9-40a8-4720-9a84-7e03c4555009', 'e8c07fb2-8d72-4796-aa05-e29cdb29f72a', '1fde4b0e-e9b7-40b8-b90a-575dd7295950'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:35 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:20:35 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Acquiring lock "cinder-8c5d0a39-3fed-4667-84ce-83985fcc4f0d-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Lock "cinder-8c5d0a39-3fed-4667-84ce-83985fcc4f0d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Acquiring lock "cinder-quobyte-8c5d0a39-3fed-4667-84ce-83985fcc4f0d" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Lock "cinder-quobyte-8c5d0a39-3fed-4667-84ce-83985fcc4f0d" acquired by "delete_volume" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[df44962f-9e19-4e06-a49c-1e64181ff9e4]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:36 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.874s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:36 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:36 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Deleted volume successfully. Jul 06 12:20:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2fba996f-18d2-44b8-acad-2b87e64139f4 tempest-VolumesListAdminTestJSON-1824642014 None] Lock "cinder-5c87370c-ef0e-4825-9dd4-a8579979d82d-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:36 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d Jul 06 12:20:36 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:36 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.880s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:36 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:36 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Deleted volume successfully. Jul 06 12:20:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1c9a0319-5ff3-42df-b9b3-c62bb68b9d9b tempest-VolumesListAdminTestJSON-977198901 None] Lock "cinder-8e6d5e59-dc74-4241-91d5-f710f1743a04-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:36 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d" returned: 0 in 0.889s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:36 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d Jul 06 12:20:36 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:37 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8c5d0a39-3fed-4667-84ce-83985fcc4f0d" returned: 0 in 0.709s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Lock "cinder-quobyte-8c5d0a39-3fed-4667-84ce-83985fcc4f0d" released by "delete_volume" :: held 1.656s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:37 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Created reservations ['21bd69ca-903e-48c9-8a88-f41176e91bfc', 'e0c2a736-cf4e-47e2-aff2-e0701f11daba', 'ceab6e00-0611-4bee-9e8a-5971c4fb9c2c', '53526e29-f7fe-4e89-8220-f045a01a5916'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:37 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:20:37 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Acquiring lock "cinder-6c37780c-6426-4b50-af38-361cd679e751-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Lock "cinder-6c37780c-6426-4b50-af38-361cd679e751-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Acquiring lock "cinder-quobyte-6c37780c-6426-4b50-af38-361cd679e751" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Lock "cinder-quobyte-6c37780c-6426-4b50-af38-361cd679e751" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:38 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[38640011-3aef-4c79-ac5e-7b4bd75f7777]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6c37780c-6426-4b50-af38-361cd679e751 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:38 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6c37780c-6426-4b50-af38-361cd679e751 Jul 06 12:20:38 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:38 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.823s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:38 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:38 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Deleted volume successfully. Jul 06 12:20:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-48224afc-c6ef-4699-8c7d-269d89460c86 tempest-VolumesListAdminTestJSON-977198901 None] Lock "cinder-8c5d0a39-3fed-4667-84ce-83985fcc4f0d-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Flow 'volume_create_manager' (7d99ae59-3262-4fb9-b71e-1f43df8dcbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e0f892-e27a-4a51-b67c-ddf182835ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e0f892-e27a-4a51-b67c-ddf182835ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1297376246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca77e22-23de-442c-8afb-5df4dc4ac75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175b5ad546a2493a88b67a8afc332c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:39Z,use_quota=True,user_id='c530125cc22e4f2ab34e58ae73b9ff25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb2698ff-621c-4dd1-944e-36b240513901),volume_type_id=fb2698ff-621c-4dd1-944e-36b240513901)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9e74b6-2f65-4bbb-9566-31368538c948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9e74b6-2f65-4bbb-9566-31368538c948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a65a7a-0621-4e74-a048-2a228809dccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a65a7a-0621-4e74-a048-2a228809dccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ca77e22-23de-442c-8afb-5df4dc4ac75c', 'volume_name': 'volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c612a6c7-4233-4619-afa2-285521f9f840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c612a6c7-4233-4619-afa2-285521f9f840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee36ac5-7f3b-447b-b0b9-c9cfa5d7bca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:39 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Volume 3ca77e22-23de-442c-8afb-5df4dc4ac75c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c', 'volume_size': 1} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1297376246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca77e22-23de-442c-8afb-5df4dc4ac75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175b5ad546a2493a88b67a8afc332c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:39Z,use_quota=True,user_id='c530125cc22e4f2ab34e58ae73b9ff25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb2698ff-621c-4dd1-944e-36b240513901),volume_type_id=fb2698ff-621c-4dd1-944e-36b240513901)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Creating volume 3ca77e22-23de-442c-8afb-5df4dc4ac75c {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:39 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:39 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c 1073741824 Jul 06 12:20:39 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:39 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6c37780c-6426-4b50-af38-361cd679e751" returned: 0 in 0.956s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6c37780c-6426-4b50-af38-361cd679e751 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:39 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6c37780c-6426-4b50-af38-361cd679e751 Jul 06 12:20:39 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:39 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-6c37780c-6426-4b50-af38-361cd679e751" returned: 0 in 0.717s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Lock "cinder-quobyte-6c37780c-6426-4b50-af38-361cd679e751" released by "delete_volume" :: held 1.727s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:40 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c 1073741824" returned: 0 in 0.885s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Created reservations ['f71bd49f-ff04-456f-961b-39a870a41766', '528ee83a-7a67-4450-859e-b0def25c049c', '774ff178-688c-40de-8119-15e427abfecc', 'c140c7cf-8a6c-4d5e-ad68-967b70d3cd22'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:40 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c Jul 06 12:20:40 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:40 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:20:40 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:40 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c" returned: 0 in 0.792s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee36ac5-7f3b-447b-b0b9-c9cfa5d7bca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f487c7d4-d256-4140-89b7-6519212728b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:40 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Volume volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c (3ca77e22-23de-442c-8afb-5df4dc4ac75c): created successfully Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f487c7d4-d256-4140-89b7-6519212728b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Flow 'volume_create_manager' (7d99ae59-3262-4fb9-b71e-1f43df8dcbe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2a316c28-854f-418a-89be-b481cb39b076 tempest-VolumeTypesAccessTest-1744940081 None] Created volume successfully. Jul 06 12:20:40 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.812s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:40 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:41 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Deleted volume successfully. Jul 06 12:20:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-901ad114-d110-49be-89bf-50d3cf950f37 tempest-VolumesListAdminTestJSON-977198901 None] Lock "cinder-6c37780c-6426-4b50-af38-361cd679e751-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Acquiring lock "cinder-3ca77e22-23de-442c-8afb-5df4dc4ac75c-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Lock "cinder-3ca77e22-23de-442c-8afb-5df4dc4ac75c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Acquiring lock "cinder-quobyte-3ca77e22-23de-442c-8afb-5df4dc4ac75c" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Lock "cinder-quobyte-3ca77e22-23de-442c-8afb-5df4dc4ac75c" acquired by "delete_volume" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:41 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[892d735d-4512-42ae-87c3-9b6143a7c45c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:41 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c Jul 06 12:20:41 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:42 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c" returned: 0 in 0.959s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:42 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c Jul 06 12:20:42 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:43 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3ca77e22-23de-442c-8afb-5df4dc4ac75c" returned: 0 in 0.854s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Lock "cinder-quobyte-3ca77e22-23de-442c-8afb-5df4dc4ac75c" released by "delete_volume" :: held 1.859s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:43 devstack cinder-volume[86761]: WARNING cinder.quota [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-183029376 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-183029376, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:20:43 devstack cinder-volume[86761]: WARNING cinder.quota [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-183029376 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-183029376, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:20:43 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Created reservations ['1a31d218-5e17-4fe1-a452-c7fdad7561ac', '57f120c2-21e9-493f-b0d1-c98f51763708', '2a3ba1af-fa32-4281-908c-deb588427937', 'd314b41f-4225-4f8f-a769-c77ded30b24b'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:43 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:20:43 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:44 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.936s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:44 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:44 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Deleted volume successfully. Jul 06 12:20:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d48c3284-6186-4f28-9fe7-6762639dc56d tempest-VolumeTypesAccessTest-1744940081 None] Lock "cinder-3ca77e22-23de-442c-8afb-5df4dc4ac75c-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Flow 'volume_create_manager' (d577144c-b71f-4da7-a1a9-216aba1f6527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e070ee9-218f-4657-aca6-0e6c6b8eda5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e070ee9-218f-4657-aca6-0e6c6b8eda5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1924284311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8dea46b-9630-4bae-b4e5-7b8db7a36ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2824da60624b86b9dbf0f307a32a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:48Z,use_quota=True,user_id='754f0cc85a6b4dc183c7f125e9eea7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4261db-ad7f-4a64-9145-0c71d2682c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4261db-ad7f-4a64-9145-0c71d2682c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2aecc60-b758-42ab-b0a7-b96e1267cba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2aecc60-b758-42ab-b0a7-b96e1267cba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8dea46b-9630-4bae-b4e5-7b8db7a36ebe', 'volume_name': 'volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4454141-e0ff-45de-9a7b-6114feab0581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4454141-e0ff-45de-9a7b-6114feab0581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2111a82c-086c-4474-8ab7-383fe6834d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:47 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Volume e8dea46b-9630-4bae-b4e5-7b8db7a36ebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe', 'volume_size': 1} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1924284311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8dea46b-9630-4bae-b4e5-7b8db7a36ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2824da60624b86b9dbf0f307a32a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:48Z,use_quota=True,user_id='754f0cc85a6b4dc183c7f125e9eea7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Creating volume e8dea46b-9630-4bae-b4e5-7b8db7a36ebe {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:47 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:20:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:47 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe 1073741824 Jul 06 12:20:47 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:48 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe 1073741824" returned: 0 in 0.974s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:48 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe Jul 06 12:20:48 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:49 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe" returned: 0 in 0.687s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2111a82c-086c-4474-8ab7-383fe6834d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fce808-1af1-4f99-affd-ffa559a7440a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:49 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Volume volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe (e8dea46b-9630-4bae-b4e5-7b8db7a36ebe): created successfully Jul 06 12:20:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fce808-1af1-4f99-affd-ffa559a7440a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Flow 'volume_create_manager' (d577144c-b71f-4da7-a1a9-216aba1f6527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:49 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-e29363cd-d91a-40a5-b9b1-18020bf67e44 tempest-VolumesTransfersTest-764352498 None] Created volume successfully. Jul 06 12:20:50 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d3eb751b-8c28-43d9-810e-ad29fadf86dc tempest-VolumesTransfersTest-1465306213 None] Transfer volume completed successfully. Jul 06 12:20:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Acquiring lock "cinder-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Lock "cinder-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Acquiring lock "cinder-quobyte-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Lock "cinder-quobyte-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe" acquired by "delete_volume" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:52 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fa767a-a95e-4242-b1de-c7e95352c934]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:52 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe Jul 06 12:20:52 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:20:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:52 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:20:52 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:53 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe" returned: 0 in 1.007s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:53 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe Jul 06 12:20:53 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:53 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.835s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:20:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:20:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:20:53 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe" returned: 0 in 0.776s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Lock "cinder-quobyte-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe" released by "delete_volume" :: held 1.839s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:54 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Created reservations ['e727139b-a225-45b2-8e72-e31ac3be3755', 'c8395c96-95b1-4f64-9845-de4320bdc816', '037e5969-ba84-4871-9e38-45be97693e54', 'f5411cfa-c054-4023-93b6-aee00718d69c'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:54 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:20:54 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:54 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.853s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:54 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:54 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Deleted volume successfully. Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7ed40ce2-3531-4cff-9992-646f22ece070 tempest-VolumesTransfersTest-2024568829 None] Lock "cinder-e8dea46b-9630-4bae-b4e5-7b8db7a36ebe-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Flow 'volume_create_manager' (f961b709-0280-4ae3-af0f-d6234294d44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750ac707-ce96-4dfa-af7e-3bf8f0db381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750ac707-ce96-4dfa-af7e-3bf8f0db381e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1734522597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d4332d-501e-4727-96b7-798e9c0c2183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2824da60624b86b9dbf0f307a32a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:55Z,use_quota=True,user_id='754f0cc85a6b4dc183c7f125e9eea7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7540fd17-5891-4a16-82d6-0636f0203aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7540fd17-5891-4a16-82d6-0636f0203aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65c1ab5-22e5-435f-8d8a-d21b49f6cc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65c1ab5-22e5-435f-8d8a-d21b49f6cc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7d4332d-501e-4727-96b7-798e9c0c2183', 'volume_name': 'volume-c7d4332d-501e-4727-96b7-798e9c0c2183', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df2f60a-9975-4562-88ed-a684fe4132a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df2f60a-9975-4562-88ed-a684fe4132a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ec0048-a60e-4777-be54-6c4b90f57b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:55 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Volume c7d4332d-501e-4727-96b7-798e9c0c2183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7d4332d-501e-4727-96b7-798e9c0c2183', 'volume_size': 1} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1734522597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d4332d-501e-4727-96b7-798e9c0c2183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2824da60624b86b9dbf0f307a32a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:55Z,use_quota=True,user_id='754f0cc85a6b4dc183c7f125e9eea7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Creating volume c7d4332d-501e-4727-96b7-798e9c0c2183 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:55 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:20:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c7d4332d-501e-4727-96b7-798e9c0c2183 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:55 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c7d4332d-501e-4727-96b7-798e9c0c2183 1073741824 Jul 06 12:20:55 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:56 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c7d4332d-501e-4727-96b7-798e9c0c2183 1073741824" returned: 0 in 0.973s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c7d4332d-501e-4727-96b7-798e9c0c2183 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:56 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c7d4332d-501e-4727-96b7-798e9c0c2183 Jul 06 12:20:56 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:56 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Flow 'volume_create_manager' (ed976706-f14b-42a4-9aae-9da0361421bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4c3f44-4cb8-42d9-914a-d79a93d50f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4c3f44-4cb8-42d9-914a-d79a93d50f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2087712323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5befbfce-869c-43c5-b572-c61b3f5e238d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c0a6764a064b369658897a282c53f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:57Z,use_quota=True,user_id='a72d7670a3cb4e6e88d69589bf0847c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300f2a14-fa17-4648-895b-7eba82b89c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300f2a14-fa17-4648-895b-7eba82b89c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089ba490-8964-42b3-a64a-9eddae6e872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089ba490-8964-42b3-a64a-9eddae6e872f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5befbfce-869c-43c5-b572-c61b3f5e238d', 'volume_name': 'volume-5befbfce-869c-43c5-b572-c61b3f5e238d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922575e0-1c4f-4a55-b621-a3a031ac1e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922575e0-1c4f-4a55-b621-a3a031ac1e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f90d79-bd29-4de7-8cae-eabee5f5c359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:56 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Volume 5befbfce-869c-43c5-b572-c61b3f5e238d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5befbfce-869c-43c5-b572-c61b3f5e238d', 'volume_size': 1} Jul 06 12:20:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:57 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c7d4332d-501e-4727-96b7-798e9c0c2183" returned: 0 in 0.724s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.157s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2087712323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5befbfce-869c-43c5-b572-c61b3f5e238d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c0a6764a064b369658897a282c53f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:57Z,use_quota=True,user_id='a72d7670a3cb4e6e88d69589bf0847c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Creating volume 5befbfce-869c-43c5-b572-c61b3f5e238d {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:57 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:57 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d 1073741824 Jul 06 12:20:57 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ec0048-a60e-4777-be54-6c4b90f57b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7d4332d-501e-4727-96b7-798e9c0c2183', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53dda92d-4758-4648-949d-3de939d9549b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:57 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Volume volume-c7d4332d-501e-4727-96b7-798e9c0c2183 (c7d4332d-501e-4727-96b7-798e9c0c2183): created successfully Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53dda92d-4758-4648-949d-3de939d9549b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Flow 'volume_create_manager' (f961b709-0280-4ae3-af0f-d6234294d44a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:57 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d5996498-67fc-486f-ae00-b800edb831e8 tempest-VolumesTransfersTest-764352498 None] Created volume successfully. Jul 06 12:20:57 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d 1073741824" returned: 0 in 0.864s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:57 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d Jul 06 12:20:57 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Acquiring lock "cinder-c7d4332d-501e-4727-96b7-798e9c0c2183-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Lock "cinder-c7d4332d-501e-4727-96b7-798e9c0c2183-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Acquiring lock "cinder-quobyte-c7d4332d-501e-4727-96b7-798e9c0c2183" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Lock "cinder-quobyte-c7d4332d-501e-4727-96b7-798e9c0c2183" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4beadb-4e44-477e-a135-89196d16cb46]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c7d4332d-501e-4727-96b7-798e9c0c2183 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:58 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d" returned: 0 in 0.753s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f90d79-bd29-4de7-8cae-eabee5f5c359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5befbfce-869c-43c5-b572-c61b3f5e238d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca34ed9-2e04-4dec-b559-6e29cd3375a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:58 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Volume volume-5befbfce-869c-43c5-b572-c61b3f5e238d (5befbfce-869c-43c5-b572-c61b3f5e238d): created successfully Jul 06 12:20:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca34ed9-2e04-4dec-b559-6e29cd3375a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Flow 'volume_create_manager' (ed976706-f14b-42a4-9aae-9da0361421bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:58 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c7d4332d-501e-4727-96b7-798e9c0c2183 Jul 06 12:20:58 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:58 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0603b164-eb40-489e-b3c5-b2b385fb4a88 tempest-VolumesCloneTest-230053458 None] Created volume successfully. Jul 06 12:20:59 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c7d4332d-501e-4727-96b7-798e9c0c2183" returned: 0 in 0.784s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c7d4332d-501e-4727-96b7-798e9c0c2183 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:59 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c7d4332d-501e-4727-96b7-798e9c0c2183 Jul 06 12:20:59 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:00 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c7d4332d-501e-4727-96b7-798e9c0c2183" returned: 0 in 0.684s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Lock "cinder-quobyte-c7d4332d-501e-4727-96b7-798e9c0c2183" released by "delete_volume" :: held 1.524s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Created reservations ['48342ae4-a54e-4125-9c70-bc4c9b2c18dc', 'af62b928-0993-4e75-b1aa-2a14a98d969f', '82dbf0d7-4a23-43b4-b1e1-9b50938329b4', '22e7ce6a-57ef-4511-8245-24edc2485db0'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:00 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:21:00 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Flow 'volume_create_manager' (54d315c1-ccbb-46c8-b2e5-29db935088cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0dd1f96-9afa-410b-8d7c-c64a677b309a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0dd1f96-9afa-410b-8d7c-c64a677b309a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1842360069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717e99d0-561c-4609-bacb-3916803fe74a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c0a6764a064b369658897a282c53f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5befbfce-869c-43c5-b572-c61b3f5e238d,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:00Z,use_quota=True,user_id='a72d7670a3cb4e6e88d69589bf0847c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69c22a9-9265-4a62-aab7-364a0df217db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69c22a9-9265-4a62-aab7-364a0df217db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae36c6b0-66d5-4a85-9735-b41ff7b04a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae36c6b0-66d5-4a85-9735-b41ff7b04a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '717e99d0-561c-4609-bacb-3916803fe74a', 'volume_name': 'volume-717e99d0-561c-4609-bacb-3916803fe74a', 'volume_size': 2, 'source_volid': '5befbfce-869c-43c5-b572-c61b3f5e238d', 'source_volstatus': 'available'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0e95b8-9252-4886-a9d1-a3f5a52792bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0e95b8-9252-4886-a9d1-a3f5a52792bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca6f8c2-2314-475e-80c2-15874afc5a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:00 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Volume 717e99d0-561c-4609-bacb-3916803fe74a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-717e99d0-561c-4609-bacb-3916803fe74a', 'volume_size': 2, 'source_volid': '5befbfce-869c-43c5-b572-c61b3f5e238d', 'source_volstatus': 'available'} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:00 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Cloning volume 5befbfce-869c-43c5-b572-c61b3f5e238d to volume 717e99d0-561c-4609-bacb-3916803fe74a Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Creating offline snapshot f642744c-25a7-416f-93cf-99d0c236534b of volume 5befbfce-869c-43c5-b572-c61b3f5e238d {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f669ff23-7004-47ce-9d32-39de0b68a35a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:00 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d Jul 06 12:21:00 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:01 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.796s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:01 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:01 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Deleted volume successfully. Jul 06 12:21:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5728aa7a-ebae-4d80-bdc9-86ae769aa6ab tempest-VolumesTransfersTest-2024568829 None] Lock "cinder-c7d4332d-501e-4727-96b7-798e9c0c2183-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:01 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d" returned: 0 in 0.825s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:01 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b 1G Jul 06 12:21:01 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:02 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b 1G" returned: 0 in 0.969s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5befbfce-869c-43c5-b572-c61b3f5e238d -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:02 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5befbfce-869c-43c5-b572-c61b3f5e238d -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b Jul 06 12:21:02 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:03 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5befbfce-869c-43c5-b572-c61b3f5e238d -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b" returned: 0 in 0.805s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:03 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b is being set with open permissions: ugo+rw Jul 06 12:21:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:03 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b Jul 06 12:21:03 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:04 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b" returned: 0 in 0.823s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:04 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.info Jul 06 12:21:04 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:05 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.info" returned: 0 in 0.859s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:05 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.info is being set with open permissions: ugo+rw Jul 06 12:21:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:05 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.info Jul 06 12:21:05 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:05 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.info" returned: 0 in 0.809s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Acquiring lock "cinder-quobyte-717e99d0-561c-4609-bacb-3916803fe74a" by "_copy_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Lock "cinder-quobyte-717e99d0-561c-4609-bacb-3916803fe74a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] snapshot: f642744c-25a7-416f-93cf-99d0c236534b, volume: 717e99d0-561c-4609-bacb-3916803fe74a, {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:21:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:05 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba7a363-e11a-4fa4-ab44-7d7ef6da000a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:06 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b Jul 06 12:21:06 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:06 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b" returned: 0 in 0.841s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5befbfce-869c-43c5-b572-c61b3f5e238d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:21:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:21:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Creating direct copy from snapshot {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:21:06 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b84582-8b10-47b1-926b-706d3354721c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:06 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d Jul 06 12:21:06 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:07 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d" returned: 0 in 0.989s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:07 devstack cinder-volume[86761]: DEBUG cinder.utils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Path /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-717e99d0-561c-4609-bacb-3916803fe74a not found in is_blk_device check {{(pid=86761) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:21:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-717e99d0-561c-4609-bacb-3916803fe74a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:07 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-717e99d0-561c-4609-bacb-3916803fe74a Jul 06 12:21:07 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:13 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-717e99d0-561c-4609-bacb-3916803fe74a" returned: 0 in 5.509s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:13 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[8339463b-cf18-4edb-be5f-fd47afc9482d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:13 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d Jul 06 12:21:13 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:14 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=69,cinder:INSERT=18,cinder:UPDATE=91,cinder:DELETE=9 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:21:14 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=56,cinder:UPDATE=93,cinder:DELETE=8,cinder:INSERT=25 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:21:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d" returned: 0 in 1.011s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:14 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-717e99d0-561c-4609-bacb-3916803fe74a {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:21:14 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Converted 1024.00 MB image at 185.83 MB/s Jul 06 12:21:14 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-717e99d0-561c-4609-bacb-3916803fe74a is being set with open permissions: ugo+rw Jul 06 12:21:14 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-717e99d0-561c-4609-bacb-3916803fe74a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:14 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-717e99d0-561c-4609-bacb-3916803fe74a Jul 06 12:21:14 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:15 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-717e99d0-561c-4609-bacb-3916803fe74a" returned: 0 in 0.818s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Lock "cinder-quobyte-717e99d0-561c-4609-bacb-3916803fe74a" released by "_copy_volume_from_snapshot" :: held 9.278s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Acquiring lock "cinder-quobyte-f642744c-25a7-416f-93cf-99d0c236534b" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Lock "cinder-quobyte-f642744c-25a7-416f-93cf-99d0c236534b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Deleting offline snapshot f642744c-25a7-416f-93cf-99d0c236534b of volume 5befbfce-869c-43c5-b572-c61b3f5e238d {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:21:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] snapshot_file for this snap is: volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:21:15 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd60795-86dc-4497-b3aa-6c152ccf8fca]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:15 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b Jul 06 12:21:15 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:16 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b" returned: 0 in 0.921s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5befbfce-869c-43c5-b572-c61b3f5e238d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:21:16 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71e898a-53bd-4cf6-ab88-6d101a09f8be]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:16 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d Jul 06 12:21:16 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:17 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d" returned: 0 in 1.059s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:17 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b Jul 06 12:21:17 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:18 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b" returned: 0 in 1.012s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:18 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b Jul 06 12:21:18 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:19 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d.f642744c-25a7-416f-93cf-99d0c236534b" returned: 0 in 0.827s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:19 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Lock "cinder-quobyte-f642744c-25a7-416f-93cf-99d0c236534b" released by "_delete_snapshot" :: held 3.972s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.578s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca6f8c2-2314-475e-80c2-15874afc5a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-717e99d0-561c-4609-bacb-3916803fe74a', 'volume_size': 2, 'source_volid': '5befbfce-869c-43c5-b572-c61b3f5e238d', 'source_volstatus': 'available'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630aa3db-8f36-4c43-a369-7eed9f10f75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:19 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Volume volume-717e99d0-561c-4609-bacb-3916803fe74a (717e99d0-561c-4609-bacb-3916803fe74a): created successfully Jul 06 12:21:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630aa3db-8f36-4c43-a369-7eed9f10f75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Flow 'volume_create_manager' (54d315c1-ccbb-46c8-b2e5-29db935088cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:19 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d13a07f3-24df-49dc-824f-cc537a6c9811 tempest-VolumesCloneTest-230053458 None] Created volume successfully. Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Flow 'volume_create_manager' (86d0eca1-b1e5-422b-91de-a947666962cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3be1fe4-ce7b-4acd-9c82-0ae02b800624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3be1fe4-ce7b-4acd-9c82-0ae02b800624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-371849949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26dbd89-c2b6-4368-a0ff-f27613c4e413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2534fbbbe314c9185f0376d733a1e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:20Z,use_quota=True,user_id='e940a6420ec24a24893e371d1ff11cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01aff32f-5d0e-42d6-bd06-015a3e7e5d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01aff32f-5d0e-42d6-bd06-015a3e7e5d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0304127-b737-4531-a89e-b28b9a42df1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0304127-b737-4531-a89e-b28b9a42df1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e26dbd89-c2b6-4368-a0ff-f27613c4e413', 'volume_name': 'volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc82e035-f83d-44c6-8520-3a6297db6425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc82e035-f83d-44c6-8520-3a6297db6425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f584170-54b3-48c1-b5c7-71b7047ad78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:20 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Volume e26dbd89-c2b6-4368-a0ff-f27613c4e413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413', 'volume_size': 1} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-371849949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26dbd89-c2b6-4368-a0ff-f27613c4e413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2534fbbbe314c9185f0376d733a1e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:20Z,use_quota=True,user_id='e940a6420ec24a24893e371d1ff11cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Creating volume e26dbd89-c2b6-4368-a0ff-f27613c4e413 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:21:20 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:20 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 1073741824 Jul 06 12:21:20 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Acquiring lock "cinder-717e99d0-561c-4609-bacb-3916803fe74a-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Lock "cinder-717e99d0-561c-4609-bacb-3916803fe74a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Acquiring lock "cinder-quobyte-717e99d0-561c-4609-bacb-3916803fe74a" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Lock "cinder-quobyte-717e99d0-561c-4609-bacb-3916803fe74a" acquired by "delete_volume" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[300e25d2-2c9e-45c0-b88e-4d514c4e255b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-717e99d0-561c-4609-bacb-3916803fe74a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:20 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-717e99d0-561c-4609-bacb-3916803fe74a Jul 06 12:21:20 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:21 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 1073741824" returned: 0 in 1.013s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:21 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 Jul 06 12:21:21 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:21 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-717e99d0-561c-4609-bacb-3916803fe74a" returned: 0 in 0.834s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-717e99d0-561c-4609-bacb-3916803fe74a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:21 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-717e99d0-561c-4609-bacb-3916803fe74a Jul 06 12:21:21 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:21 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413" returned: 0 in 0.745s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:21:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f584170-54b3-48c1-b5c7-71b7047ad78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5096e8-2a3f-4fcb-bc0a-f4c6ac80c64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:21 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Volume volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 (e26dbd89-c2b6-4368-a0ff-f27613c4e413): created successfully Jul 06 12:21:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5096e8-2a3f-4fcb-bc0a-f4c6ac80c64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Flow 'volume_create_manager' (86d0eca1-b1e5-422b-91de-a947666962cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:21 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-93c1f587-4f12-4f62-9405-255823a8412f tempest-VolumesSnapshotTestJSON-873636441 None] Created volume successfully. Jul 06 12:21:22 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-717e99d0-561c-4609-bacb-3916803fe74a" returned: 0 in 0.764s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Lock "cinder-quobyte-717e99d0-561c-4609-bacb-3916803fe74a" released by "delete_volume" :: held 1.647s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Created reservations ['59a48548-35cc-4489-8d92-6e5453b0a7eb', 'ef2c0ec8-f5c9-4556-a394-12c32311a101', '1361a942-6b04-42d8-9ac5-a9f0ffac0ba2', '1470ff84-aa89-41bb-804b-f13aca792543'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:22 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:21:22 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] Creating offline snapshot ca0b9e02-87f1-45dd-9474-649afd81276c of volume e26dbd89-c2b6-4368-a0ff-f27613c4e413 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[399cc48d-65f4-4379-b090-7f3e029a6784]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:22 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 Jul 06 12:21:22 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Acquiring lock "cinder-5befbfce-869c-43c5-b572-c61b3f5e238d-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Lock "cinder-5befbfce-869c-43c5-b572-c61b3f5e238d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Acquiring lock "cinder-quobyte-5befbfce-869c-43c5-b572-c61b3f5e238d" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Lock "cinder-quobyte-5befbfce-869c-43c5-b572-c61b3f5e238d" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cca0a12-2bf9-4b5a-9953-ece55e250434]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:23 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d Jul 06 12:21:23 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:23 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.775s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:23 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:23 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Deleted volume successfully. Jul 06 12:21:23 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-93dc6be6-5982-4be1-9c43-c7ba7bc05151 tempest-VolumesCloneTest-230053458 None] Lock "cinder-717e99d0-561c-4609-bacb-3916803fe74a-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:23 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413" returned: 0 in 0.911s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:23 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c 1G Jul 06 12:21:23 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:23 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d" returned: 0 in 0.865s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:23 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d Jul 06 12:21:23 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:24 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c 1G" returned: 0 in 0.939s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:24 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c Jul 06 12:21:24 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:24 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5befbfce-869c-43c5-b572-c61b3f5e238d" returned: 0 in 0.738s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Lock "cinder-quobyte-5befbfce-869c-43c5-b572-c61b3f5e238d" released by "delete_volume" :: held 1.682s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:24 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Created reservations ['54ac9dd2-f99e-4132-8013-101b1d692625', '91bbe444-1892-43fe-89bc-089fdfb59c54', 'c15268f2-ddee-46fe-a255-6dced3736f11', '64a2bcb1-369a-46d7-ab99-adfb1d725451'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:24 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:21:24 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:25 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c" returned: 0 in 0.851s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:25 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c is being set with open permissions: ugo+rw Jul 06 12:21:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:25 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c Jul 06 12:21:25 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:25 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.865s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:25 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:25 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Deleted volume successfully. Jul 06 12:21:25 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b31dd662-fdb3-4994-8075-af5ab516fb74 tempest-VolumesCloneTest-230053458 None] Lock "cinder-5befbfce-869c-43c5-b572-c61b3f5e238d-delete_volume" released by "delete_volume" :: held 2.829s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:26 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c" returned: 0 in 0.824s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:26 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.info Jul 06 12:21:26 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:26 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.info" returned: 0 in 0.884s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:26 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.info is being set with open permissions: ugo+rw Jul 06 12:21:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:26 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.info Jul 06 12:21:26 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:27 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.info" returned: 0 in 0.809s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.337s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:27 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6aaa26af-552f-4cb2-8054-fadb8852d4bf tempest-VolumesSnapshotTestJSON-873636441 None] Create snapshot completed successfully Jul 06 12:21:28 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Flow 'volume_create_manager' (804bda91-090d-49a1-ab37-2d2643e98a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eeccd7b-5c3c-4d5c-94ea-24c8003bdd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:28 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-ca0b9e02-87f1-45dd-9474-649afd81276c-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eeccd7b-5c3c-4d5c-94ea-24c8003bdd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-415217565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcc301d-9fd7-457e-b15e-a8fce759eea2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='12796226689647a9885a781985a17a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:29Z,use_quota=True,user_id='2d78cc776a974fb49d06638175565dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ccfafe-b3b2-489e-ba89-b15b1db2e93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ccfafe-b3b2-489e-ba89-b15b1db2e93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429d70c1-fe06-492f-bd3c-3a17e21f92de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429d70c1-fe06-492f-bd3c-3a17e21f92de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dcc301d-9fd7-457e-b15e-a8fce759eea2', 'volume_name': 'volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91962079-10f2-4fa6-b57f-72c7f0235d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91962079-10f2-4fa6-b57f-72c7f0235d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58810013-5d74-47f4-a535-4fffac8d6ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:29 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Volume 4dcc301d-9fd7-457e-b15e-a8fce759eea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2', 'volume_size': 1} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-415217565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcc301d-9fd7-457e-b15e-a8fce759eea2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='12796226689647a9885a781985a17a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:29Z,use_quota=True,user_id='2d78cc776a974fb49d06638175565dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Creating volume 4dcc301d-9fd7-457e-b15e-a8fce759eea2 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:21:29 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-ca0b9e02-87f1-45dd-9474-649afd81276c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.096s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:29 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2 1073741824 Jul 06 12:21:29 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-quobyte-e26dbd89-c2b6-4368-a0ff-f27613c4e413" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-e26dbd89-c2b6-4368-a0ff-f27613c4e413" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-quobyte-ca0b9e02-87f1-45dd-9474-649afd81276c" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-ca0b9e02-87f1-45dd-9474-649afd81276c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Deleting offline snapshot ca0b9e02-87f1-45dd-9474-649afd81276c of volume e26dbd89-c2b6-4368-a0ff-f27613c4e413 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] snapshot_file for this snap is: volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2db067-45da-453b-bdc9-c15255ff7169]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:29 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c Jul 06 12:21:29 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:30 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2 1073741824" returned: 0 in 0.979s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:30 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2 Jul 06 12:21:30 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:30 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c" returned: 0 in 0.934s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:21:30 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc76672-e9af-4866-a75e-be448e461c43]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:30 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 Jul 06 12:21:30 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:30 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2" returned: 0 in 0.691s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:21:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58810013-5d74-47f4-a535-4fffac8d6ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30295301-9fb6-4e0b-ab5e-fc94a5ba5a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:30 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Volume volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2 (4dcc301d-9fd7-457e-b15e-a8fce759eea2): created successfully Jul 06 12:21:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30295301-9fb6-4e0b-ab5e-fc94a5ba5a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Flow 'volume_create_manager' (804bda91-090d-49a1-ab37-2d2643e98a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:30 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-3ff2619c-23f6-47c2-b58b-8b70aa48f64b tempest-VolumesGetTest-1482037949 None] Created volume successfully. Jul 06 12:21:30 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413" returned: 0 in 0.845s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:31 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c Jul 06 12:21:31 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Flow 'volume_create_manager' (5259da25-9c6c-4850-b7e2-53c5ba9b7fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dafdf42-6106-4f46-8dc5-dfb1a17563ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dafdf42-6106-4f46-8dc5-dfb1a17563ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1300945626',display_name='tempest-VolumesGetTest-Volume-332255960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4074d1f8-bbbd-4d29-8bae-ff85a6d36050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12796226689647a9885a781985a17a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:32Z,use_quota=True,user_id='2d78cc776a974fb49d06638175565dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce3d025-7fed-4d71-b637-125bb48bcc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce3d025-7fed-4d71-b637-125bb48bcc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ee8f14-b4c7-4fec-bba8-95583549a407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ee8f14-b4c7-4fec-bba8-95583549a407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4074d1f8-bbbd-4d29-8bae-ff85a6d36050', 'volume_name': 'volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1618f901-d132-4e32-8b06-02803c74d6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:31 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1618f901-d132-4e32-8b06-02803c74d6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14feb1a9-ba46-463f-89f2-9ab3db83c2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:31 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Volume 4074d1f8-bbbd-4d29-8bae-ff85a6d36050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050', 'volume_size': 1} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1300945626',display_name='tempest-VolumesGetTest-Volume-332255960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4074d1f8-bbbd-4d29-8bae-ff85a6d36050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12796226689647a9885a781985a17a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:32Z,use_quota=True,user_id='2d78cc776a974fb49d06638175565dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Creating volume 4074d1f8-bbbd-4d29-8bae-ff85a6d36050 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:21:31 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c" returned: 0 in 0.896s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:31 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050 1073741824 Jul 06 12:21:31 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:31 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c Jul 06 12:21:31 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:32 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413.ca0b9e02-87f1-45dd-9474-649afd81276c" returned: 0 in 0.690s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-ca0b9e02-87f1-45dd-9474-649afd81276c" released by "_delete_snapshot" :: held 3.492s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-e26dbd89-c2b6-4368-a0ff-f27613c4e413" released by "delete_snapshot" :: held 3.521s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:32 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Created reservations ['538d05a6-76fb-4a3e-9ea2-0f43934d7049', '40c1d28f-1f40-416d-9b37-46aa3e7e3169', 'f500d8f6-bebf-4bf6-998c-02bbf972b47a', 'a7e40ace-38b1-4c4e-8536-029a1f447c54'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:32 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Delete snapshot completed successfully. Jul 06 12:21:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7a1e3d26-ec08-439e-aa97-f49cd18bccbe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-ca0b9e02-87f1-45dd-9474-649afd81276c-delete_snapshot" released by "delete_snapshot" :: held 3.739s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:32 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050 1073741824" returned: 0 in 0.930s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:32 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050 Jul 06 12:21:32 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:33 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050" returned: 0 in 0.769s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14feb1a9-ba46-463f-89f2-9ab3db83c2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b20b4cb-9159-4f22-8beb-3fea1e9e4025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:33 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Volume volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050 (4074d1f8-bbbd-4d29-8bae-ff85a6d36050): created successfully Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b20b4cb-9159-4f22-8beb-3fea1e9e4025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Flow 'volume_create_manager' (5259da25-9c6c-4850-b7e2-53c5ba9b7fa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:33 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ea0b42a6-8df1-481f-8d7a-8d4e30cdf954 tempest-VolumesGetTest-1482037949 None] Created volume successfully. Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Flow 'volume_create_manager' (19a32703-7d96-4773-b3f5-24a78eb493c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da69923-f05f-4244-985f-fb071b23c046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da69923-f05f-4244-985f-fb071b23c046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2111796846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a427654-9838-48c8-957d-9726fdd44cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2534fbbbe314c9185f0376d733a1e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:34Z,use_quota=True,user_id='e940a6420ec24a24893e371d1ff11cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80518ffc-e9ae-4a1e-8c80-01dc5c9aacc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80518ffc-e9ae-4a1e-8c80-01dc5c9aacc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4394062d-45a1-496e-bc51-902c178d1f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4394062d-45a1-496e-bc51-902c178d1f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a427654-9838-48c8-957d-9726fdd44cb2', 'volume_name': 'volume-8a427654-9838-48c8-957d-9726fdd44cb2', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92079ce2-adb1-4e96-a38f-11f0f72dc154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92079ce2-adb1-4e96-a38f-11f0f72dc154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afa2caa-7dd5-457b-bae2-77113195ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:33 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Volume 8a427654-9838-48c8-957d-9726fdd44cb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a427654-9838-48c8-957d-9726fdd44cb2', 'volume_size': 1} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2111796846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a427654-9838-48c8-957d-9726fdd44cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2534fbbbe314c9185f0376d733a1e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:34Z,use_quota=True,user_id='e940a6420ec24a24893e371d1ff11cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Creating volume 8a427654-9838-48c8-957d-9726fdd44cb2 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:21:33 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:21:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-4074d1f8-bbbd-4d29-8bae-ff85a6d36050-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Lock "cinder-4074d1f8-bbbd-4d29-8bae-ff85a6d36050-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:34 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 1073741824 Jul 06 12:21:34 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-quobyte-4074d1f8-bbbd-4d29-8bae-ff85a6d36050" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-4074d1f8-bbbd-4d29-8bae-ff85a6d36050" acquired by "delete_volume" :: waited 0.014s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:34 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[420e2d1c-0227-46b0-b5f9-d3001dcec066]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:34 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050 Jul 06 12:21:34 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:34 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050" returned: 0 in 0.821s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:34 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 1073741824" returned: 0 in 0.952s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:34 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050 Jul 06 12:21:34 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:35 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 Jul 06 12:21:35 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:35 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4074d1f8-bbbd-4d29-8bae-ff85a6d36050" returned: 0 in 0.664s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-4074d1f8-bbbd-4d29-8bae-ff85a6d36050" released by "delete_volume" :: held 1.536s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:35 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2" returned: 0 in 0.654s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afa2caa-7dd5-457b-bae2-77113195ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a427654-9838-48c8-957d-9726fdd44cb2', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38fd04b-d780-4dc0-a9a7-d165ca871e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:35 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Volume volume-8a427654-9838-48c8-957d-9726fdd44cb2 (8a427654-9838-48c8-957d-9726fdd44cb2): created successfully Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38fd04b-d780-4dc0-a9a7-d165ca871e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Flow 'volume_create_manager' (19a32703-7d96-4773-b3f5-24a78eb493c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:35 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a734b336-94f9-40d5-84c2-6bfeb9a819da tempest-VolumesSnapshotTestJSON-873636441 None] Created volume successfully. Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Created reservations ['499c203c-4423-414e-9da9-6a45c255c0d1', 'f7404132-8590-48d0-9c1d-677056f8ceaa', '9eda13e6-b9d7-4b29-bfb1-f724b66e888c', '6cab00b2-6f78-4d59-b25a-8ace2ce27376'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:35 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:21:35 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] Creating offline snapshot 4892d5a7-e457-4582-ae8e-f418cd1e24d3 of volume 8a427654-9838-48c8-957d-9726fdd44cb2 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:21:36 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bd9fde-4622-4195-9078-2c1b1d7b8b16]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-4dcc301d-9fd7-457e-b15e-a8fce759eea2-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:36 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 Jul 06 12:21:36 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Lock "cinder-4dcc301d-9fd7-457e-b15e-a8fce759eea2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-quobyte-4dcc301d-9fd7-457e-b15e-a8fce759eea2" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-4dcc301d-9fd7-457e-b15e-a8fce759eea2" acquired by "delete_volume" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:36 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb92f919-a85b-4773-9141-678c40da486a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:36 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.724s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:36 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:36 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Deleted volume successfully. Jul 06 12:21:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b98e3191-32bd-44e8-9d1c-29663a9e1218 tempest-VolumesGetTest-1482037949 None] Lock "cinder-4074d1f8-bbbd-4d29-8bae-ff85a6d36050-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:36 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2 Jul 06 12:21:36 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:37 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2" returned: 0 in 0.908s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:37 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 1G Jul 06 12:21:37 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:37 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2" returned: 0 in 0.868s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:37 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2 Jul 06 12:21:37 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:38 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 1G" returned: 0 in 0.935s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a427654-9838-48c8-957d-9726fdd44cb2 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:38 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:38 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a427654-9838-48c8-957d-9726fdd44cb2 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 Jul 06 12:21:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4dcc301d-9fd7-457e-b15e-a8fce759eea2" returned: 0 in 0.744s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:38 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-4dcc301d-9fd7-457e-b15e-a8fce759eea2" released by "delete_volume" :: held 1.665s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:38 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Created reservations ['85bb3bcd-03f5-41f7-a426-4d4c12e6e08a', '37f3e6f2-4353-4b42-842a-e1c4d462be16', '25099aea-968a-4c4a-b516-757764bfd2a4', '7d1a1c51-311b-477d-b4fc-39ee178c7ddb'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:38 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:21:38 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:38 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a427654-9838-48c8-957d-9726fdd44cb2 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3" returned: 0 in 0.818s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:38 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 is being set with open permissions: ugo+rw Jul 06 12:21:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:38 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 Jul 06 12:21:38 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:39 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.795s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:39 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Deleted volume successfully. Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d975bc47-09f9-4b00-bdcd-4514aab3d6a9 tempest-VolumesGetTest-1482037949 None] Lock "cinder-4dcc301d-9fd7-457e-b15e-a8fce759eea2-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Flow 'volume_create_manager' (4257ce03-8876-4617-a6e0-54c2d785edb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58e29f8-48c2-40e4-a26f-e56216d8ef8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58e29f8-48c2-40e4-a26f-e56216d8ef8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1494172633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fcd71e6-fe3a-4bc4-b596-c953b1746af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12796226689647a9885a781985a17a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:39Z,use_quota=True,user_id='2d78cc776a974fb49d06638175565dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969a2c3d-be44-409d-b0bd-ee3984e1709c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969a2c3d-be44-409d-b0bd-ee3984e1709c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c829cb-408d-42a3-b9e7-da916562176a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c829cb-408d-42a3-b9e7-da916562176a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fcd71e6-fe3a-4bc4-b596-c953b1746af1', 'volume_name': 'volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f3ecf2-1f19-4c42-a70b-e516f76e4a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f3ecf2-1f19-4c42-a70b-e516f76e4a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f209a8a-5176-41cc-80f8-aa606295fec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:39 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Volume 8fcd71e6-fe3a-4bc4-b596-c953b1746af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1', 'volume_size': 1} Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:39 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3" returned: 0 in 0.733s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:39 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.info Jul 06 12:21:39 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:40 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.info" returned: 0 in 0.727s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:40 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.info is being set with open permissions: ugo+rw Jul 06 12:21:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:40 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.info Jul 06 12:21:40 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:41 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.info" returned: 0 in 0.719s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.964s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.832s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1494172633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fcd71e6-fe3a-4bc4-b596-c953b1746af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12796226689647a9885a781985a17a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:39Z,use_quota=True,user_id='2d78cc776a974fb49d06638175565dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:21:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Creating volume 8fcd71e6-fe3a-4bc4-b596-c953b1746af1 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:21:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:21:41 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:21:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:41 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 1073741824 Jul 06 12:21:41 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:41 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-beb6f94c-3f0c-4402-a86d-ba0502a6ca09 tempest-VolumesSnapshotTestJSON-873636441 None] Create snapshot completed successfully Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Flow 'volume_create_manager' (7f2cc27a-8ab0-4c88-be9f-66ac0221cd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d593081b-d7a9-49be-addf-6e09498328ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d593081b-d7a9-49be-addf-6e09498328ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-597218230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed38127-4a68-4bd0-a908-1fb39b51e8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2534fbbbe314c9185f0376d733a1e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4892d5a7-e457-4582-ae8e-f418cd1e24d3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:42Z,use_quota=True,user_id='e940a6420ec24a24893e371d1ff11cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4ec82a-1d9d-4e79-810d-cdde80a4074f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4ec82a-1d9d-4e79-810d-cdde80a4074f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4e5e10-83b9-473c-8cae-79097d6353dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4e5e10-83b9-473c-8cae-79097d6353dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8ed38127-4a68-4bd0-a908-1fb39b51e8f1', 'volume_name': 'volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1', 'volume_size': 2, 'snapshot_id': '4892d5a7-e457-4582-ae8e-f418cd1e24d3'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc63dd3-b8c0-41d3-baf0-f9e5ea02084c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc63dd3-b8c0-41d3-baf0-f9e5ea02084c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ad397a-7e6b-424e-8f6e-b8e84ae58003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:42 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Volume 8ed38127-4a68-4bd0-a908-1fb39b51e8f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1', 'volume_size': 2, 'snapshot_id': '4892d5a7-e457-4582-ae8e-f418cd1e24d3'} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:42 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 1073741824" returned: 0 in 1.007s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:42 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 Jul 06 12:21:42 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:42 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1" returned: 0 in 0.679s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.737s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-quobyte-4892d5a7-e457-4582-ae8e-f418cd1e24d3-8ed38127-4a68-4bd0-a908-1fb39b51e8f1" by "_create_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f209a8a-5176-41cc-80f8-aa606295fec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4ec196-68c6-4b6c-a8c8-f96b3e1a60d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-4892d5a7-e457-4582-ae8e-f418cd1e24d3-8ed38127-4a68-4bd0-a908-1fb39b51e8f1" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Creating volume 8ed38127-4a68-4bd0-a908-1fb39b51e8f1 from snapshot 4892d5a7-e457-4582-ae8e-f418cd1e24d3 {{(pid=86761) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-quobyte-8ed38127-4a68-4bd0-a908-1fb39b51e8f1" by "_copy_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:42 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Volume volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 (8fcd71e6-fe3a-4bc4-b596-c953b1746af1): created successfully Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4ec196-68c6-4b6c-a8c8-f96b3e1a60d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Flow 'volume_create_manager' (4257ce03-8876-4617-a6e0-54c2d785edb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-8ed38127-4a68-4bd0-a908-1fb39b51e8f1" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] snapshot: 4892d5a7-e457-4582-ae8e-f418cd1e24d3, volume: 8ed38127-4a68-4bd0-a908-1fb39b51e8f1, {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:21:43 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-195b6977-051b-405b-9f56-9dd636de8c03 tempest-VolumesGetTest-1482037949 None] Created volume successfully. Jul 06 12:21:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:43 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5bca9a-45de-4654-af79-8ce55415bd19]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:43 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 Jul 06 12:21:43 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:43 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3" returned: 0 in 0.924s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a427654-9838-48c8-957d-9726fdd44cb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:21:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:21:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Creating direct copy from snapshot {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c031f6-f5f7-43ad-87cb-eea0d4f49e03]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Flow 'volume_create_manager' (901bcd05-78ee-42c7-a99d-dbeaa7e4cb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e07664-8c28-4cdc-99ed-8d0edb82e846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e07664-8c28-4cdc-99ed-8d0edb82e846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1678473406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed044b5-9af0-49cb-bb57-07a321ca1e23,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='12796226689647a9885a781985a17a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8fcd71e6-fe3a-4bc4-b596-c953b1746af1,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:44Z,use_quota=True,user_id='2d78cc776a974fb49d06638175565dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:44 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 Jul 06 12:21:44 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bf0d80-4946-42b7-96bb-d8fab362d0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bf0d80-4946-42b7-96bb-d8fab362d0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389ce9b4-d818-4757-8378-94464ef8bffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389ce9b4-d818-4757-8378-94464ef8bffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7ed044b5-9af0-49cb-bb57-07a321ca1e23', 'volume_name': 'volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23', 'volume_size': 1, 'source_volid': '8fcd71e6-fe3a-4bc4-b596-c953b1746af1', 'source_volstatus': 'available'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655ac423-f77b-4c71-b239-b0dc8b939332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655ac423-f77b-4c71-b239-b0dc8b939332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b86d988-671e-455d-b70e-671ba08a57e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:44 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Volume 7ed044b5-9af0-49cb-bb57-07a321ca1e23: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23', 'volume_size': 1, 'source_volid': '8fcd71e6-fe3a-4bc4-b596-c953b1746af1', 'source_volstatus': 'available'} Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:44 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2" returned: 0 in 0.794s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG cinder.utils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Path /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1 not found in is_blk_device check {{(pid=86761) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:21:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:44 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1 Jul 06 12:21:44 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:49 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1" returned: 0 in 4.635s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:49 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b2799e-aa30-4ef1-8519-22d4c6e1cf71]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:49 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 Jul 06 12:21:49 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:50 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2" returned: 0 in 0.973s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:50 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2, size 1024.00 MB, duration 4.64 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:21:50 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Converted 1024.00 MB image at 220.84 MB/s Jul 06 12:21:50 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1 is being set with open permissions: ugo+rw Jul 06 12:21:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:50 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1 Jul 06 12:21:50 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:51 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1" returned: 0 in 0.695s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-8ed38127-4a68-4bd0-a908-1fb39b51e8f1" released by "_copy_volume_from_snapshot" :: held 8.142s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-4892d5a7-e457-4582-ae8e-f418cd1e24d3-8ed38127-4a68-4bd0-a908-1fb39b51e8f1" released by "_create_volume_from_snapshot" :: held 8.201s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.251s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.938s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:51 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Cloning volume 8fcd71e6-fe3a-4bc4-b596-c953b1746af1 to volume 7ed044b5-9af0-49cb-bb57-07a321ca1e23 Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ad397a-7e6b-424e-8f6e-b8e84ae58003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1', 'volume_size': 2, 'snapshot_id': '4892d5a7-e457-4582-ae8e-f418cd1e24d3'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a992ec7e-678b-4e9e-8904-36b1272adb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Creating offline snapshot fad48921-c0f4-450a-a9c2-20b2886c4f48 of volume 8fcd71e6-fe3a-4bc4-b596-c953b1746af1 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:21:51 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Volume volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1 (8ed38127-4a68-4bd0-a908-1fb39b51e8f1): created successfully Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a992ec7e-678b-4e9e-8904-36b1272adb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Flow 'volume_create_manager' (7f2cc27a-8ab0-4c88-be9f-66ac0221cd72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aee278e-2aff-4672-afc4-ba8faa983f77]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-61b4a85e-56cb-45e0-85e7-3edbc5b873fe tempest-VolumesSnapshotTestJSON-873636441 None] Created volume successfully. Jul 06 12:21:51 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 Jul 06 12:21:51 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-8ed38127-4a68-4bd0-a908-1fb39b51e8f1-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-8ed38127-4a68-4bd0-a908-1fb39b51e8f1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-quobyte-8ed38127-4a68-4bd0-a908-1fb39b51e8f1" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-8ed38127-4a68-4bd0-a908-1fb39b51e8f1" acquired by "delete_volume" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb706ada-3100-46e0-96ae-4fdc0282c00d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:52 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1" returned: 0 in 0.778s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:52 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1 Jul 06 12:21:52 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:52 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 1G Jul 06 12:21:52 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:21:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:52 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:21:52 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:52 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1" returned: 0 in 0.825s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:52 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1 Jul 06 12:21:52 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:52 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 1G" returned: 0 in 0.886s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:52 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 Jul 06 12:21:52 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:53 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.764s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:21:53 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8ed38127-4a68-4bd0-a908-1fb39b51e8f1" returned: 0 in 0.710s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-8ed38127-4a68-4bd0-a908-1fb39b51e8f1" released by "delete_volume" :: held 1.579s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Created reservations ['4437ae28-f155-47ad-97cd-7701085d77c1', '9626a16b-e4d1-41a6-86a7-0ca17222ec1f', 'b3255a31-84a1-41f7-a6a4-5f902d750e19', 'd421b768-970b-480f-8922-44f0514253fe'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:53 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:21:53 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:53 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48" returned: 0 in 0.843s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:53 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 is being set with open permissions: ugo+rw Jul 06 12:21:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:53 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 Jul 06 12:21:53 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-4892d5a7-e457-4582-ae8e-f418cd1e24d3-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-4892d5a7-e457-4582-ae8e-f418cd1e24d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-quobyte-8a427654-9838-48c8-957d-9726fdd44cb2" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-8a427654-9838-48c8-957d-9726fdd44cb2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-quobyte-4892d5a7-e457-4582-ae8e-f418cd1e24d3" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-4892d5a7-e457-4582-ae8e-f418cd1e24d3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Deleting offline snapshot 4892d5a7-e457-4582-ae8e-f418cd1e24d3 of volume 8a427654-9838-48c8-957d-9726fdd44cb2 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:21:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] snapshot_file for this snap is: volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:21:54 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b78ab6-8c29-428c-866b-27275a735d57]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:54 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.771s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:54 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 Jul 06 12:21:54 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:54 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:54 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Deleted volume successfully. Jul 06 12:21:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bbc02a96-d5d9-4cf3-8d41-da0fef7662b0 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-8ed38127-4a68-4bd0-a908-1fb39b51e8f1-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:54 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48" returned: 0 in 0.727s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:54 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.info Jul 06 12:21:54 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:55 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3" returned: 0 in 0.900s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a427654-9838-48c8-957d-9726fdd44cb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:21:55 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9530fe31-5b8d-4cd4-a361-93938c19cd49]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:55 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 Jul 06 12:21:55 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:55 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.info" returned: 0 in 0.882s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:55 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.info is being set with open permissions: ugo+rw Jul 06 12:21:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:55 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.info Jul 06 12:21:55 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:56 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2" returned: 0 in 0.916s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:56 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 Jul 06 12:21:56 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:56 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.info" returned: 0 in 0.849s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:56 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-quobyte-7ed044b5-9af0-49cb-bb57-07a321ca1e23" by "_copy_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:56 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-7ed044b5-9af0-49cb-bb57-07a321ca1e23" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] snapshot: fad48921-c0f4-450a-a9c2-20b2886c4f48, volume: 7ed044b5-9af0-49cb-bb57-07a321ca1e23, {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:21:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:56 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[037ce71d-210b-4c63-b0c6-7665e364cf7e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:56 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 Jul 06 12:21:56 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:57 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3" returned: 0 in 0.903s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:57 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3 Jul 06 12:21:57 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:57 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48" returned: 0 in 0.841s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:21:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:21:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Creating direct copy from snapshot {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:21:57 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee50f8f-e676-4878-82de-5a525f38abf9]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:57 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 Jul 06 12:21:57 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:57 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2.4892d5a7-e457-4582-ae8e-f418cd1e24d3" returned: 0 in 0.762s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-4892d5a7-e457-4582-ae8e-f418cd1e24d3" released by "_delete_snapshot" :: held 3.604s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-8a427654-9838-48c8-957d-9726fdd44cb2" released by "delete_snapshot" :: held 3.633s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:57 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Created reservations ['d2a98fea-0834-445b-b2d5-fa442c01a92a', 'e4874d5f-867c-4ddb-a94f-71514d9ac483', 'fef2e178-aff5-4655-bde3-ceb00decf722', '1ea9cbfb-fc14-4b62-9871-a648720440f2'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:57 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Delete snapshot completed successfully. Jul 06 12:21:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4a3ea7e1-5973-4a74-9ef9-d1305bf319c2 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-4892d5a7-e457-4582-ae8e-f418cd1e24d3-delete_snapshot" released by "delete_snapshot" :: held 3.809s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:58 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1" returned: 0 in 0.881s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:58 devstack cinder-volume[86761]: DEBUG cinder.utils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Path /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23 not found in is_blk_device check {{(pid=86761) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:21:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:58 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23 Jul 06 12:21:58 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-8a427654-9838-48c8-957d-9726fdd44cb2-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-8a427654-9838-48c8-957d-9726fdd44cb2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-quobyte-8a427654-9838-48c8-957d-9726fdd44cb2" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-8a427654-9838-48c8-957d-9726fdd44cb2" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0243455e-098c-4892-8e54-4012b9f6cc60]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:58 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 Jul 06 12:21:58 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:00 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2" returned: 0 in 1.449s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:00 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2 Jul 06 12:22:00 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:01 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8a427654-9838-48c8-957d-9726fdd44cb2" returned: 0 in 1.448s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-8a427654-9838-48c8-957d-9726fdd44cb2" released by "delete_volume" :: held 3.020s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:01 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Created reservations ['173b091f-6999-4df7-a895-5484c2442823', '22bd886b-0663-40d5-a582-08abde2368e5', '72050fe9-fc77-4ebe-8567-dbda61fcde64', 'ccebb0e3-09a7-4d38-95e0-948fd4fc4838'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:02 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:22:02 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:03 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.706s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:03 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Deleted volume successfully. Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2d3131fa-8468-481d-8d41-ebdf3163013d tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-8a427654-9838-48c8-957d-9726fdd44cb2-delete_volume" released by "delete_volume" :: held 5.186s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Flow 'volume_create_manager' (3d22deb8-5510-49e9-a71f-bdc65ba4646e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3675248-9c92-4c6b-8686-5fb10aaccb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3675248-9c92-4c6b-8686-5fb10aaccb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-497904232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2534fbbbe314c9185f0376d733a1e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:04Z,use_quota=True,user_id='e940a6420ec24a24893e371d1ff11cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb63104f-faa0-4789-ab1d-e87ad3bd0fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb63104f-faa0-4789-ab1d-e87ad3bd0fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f046b1fb-cb33-4d13-9bff-3cdc856901e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f046b1fb-cb33-4d13-9bff-3cdc856901e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0', 'volume_name': 'volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3ef949-1389-4a42-bd79-412c91cb291a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3ef949-1389-4a42-bd79-412c91cb291a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499c7c3f-d3bf-4871-9419-9b4efd2e2145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:03 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Volume 5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0', 'volume_size': 1} Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:03 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23" returned: 0 in 5.903s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:04 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca4689b-0f5b-4818-9978-1bb67edb5fcd]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:04 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 Jul 06 12:22:04 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:05 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1" returned: 0 in 1.016s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:05 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:22:05 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Converted 1024.00 MB image at 173.44 MB/s Jul 06 12:22:05 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23 is being set with open permissions: ugo+rw Jul 06 12:22:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:05 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23 Jul 06 12:22:05 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:05 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23" returned: 0 in 0.658s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-7ed044b5-9af0-49cb-bb57-07a321ca1e23" released by "_copy_volume_from_snapshot" :: held 9.388s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-quobyte-fad48921-c0f4-450a-a9c2-20b2886c4f48" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-fad48921-c0f4-450a-a9c2-20b2886c4f48" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Deleting offline snapshot fad48921-c0f4-450a-a9c2-20b2886c4f48 of volume 8fcd71e6-fe3a-4bc4-b596-c953b1746af1 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:22:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] snapshot_file for this snap is: volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:22:05 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d4ac25-7710-427a-8f9e-5c75895d9311]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:05 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 Jul 06 12:22:05 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:06 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48" returned: 0 in 0.840s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:22:06 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9394102d-b5b3-413c-96a2-79ed93782dd0]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:06 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 Jul 06 12:22:06 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:07 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1" returned: 0 in 0.744s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:07 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 Jul 06 12:22:07 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:08 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48" returned: 0 in 0.750s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:08 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48 Jul 06 12:22:08 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:08 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1.fad48921-c0f4-450a-a9c2-20b2886c4f48" returned: 0 in 0.686s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-fad48921-c0f4-450a-a9c2-20b2886c4f48" released by "_delete_snapshot" :: held 3.143s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.755s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.976s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-497904232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2534fbbbe314c9185f0376d733a1e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:04Z,use_quota=True,user_id='e940a6420ec24a24893e371d1ff11cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Creating volume 5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:08 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b86d988-671e-455d-b70e-671ba08a57e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23', 'volume_size': 1, 'source_volid': '8fcd71e6-fe3a-4bc4-b596-c953b1746af1', 'source_volstatus': 'available'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:08 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 1073741824 Jul 06 12:22:08 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1455dcda-aa69-4dd6-9682-8418118fcbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:08 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Volume volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23 (7ed044b5-9af0-49cb-bb57-07a321ca1e23): created successfully Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1455dcda-aa69-4dd6-9682-8418118fcbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Flow 'volume_create_manager' (901bcd05-78ee-42c7-a99d-dbeaa7e4cb4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:08 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0ce16ccc-2ff9-4974-bdb5-b587e6b1a99d tempest-VolumesGetTest-1482037949 None] Created volume successfully. Jul 06 12:22:09 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 1073741824" returned: 0 in 1.016s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:10 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 Jul 06 12:22:10 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Flow 'volume_create_manager' (58647cbc-2075-48d9-b9e9-22941ad93e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4114e4-4ce1-4c10-8b8c-5808053d838a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4114e4-4ce1-4c10-8b8c-5808053d838a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-741205256',display_name='tempest-VolumesGetTest-Volume-429996884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e47870-456a-474c-b178-acd9f27e8698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12796226689647a9885a781985a17a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:10Z,use_quota=True,user_id='2d78cc776a974fb49d06638175565dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34df2c0e-3fa6-426b-a0f2-8b27cd6ca150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34df2c0e-3fa6-426b-a0f2-8b27cd6ca150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b1c174-a042-44ca-b050-95864a388160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b1c174-a042-44ca-b050-95864a388160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e47870-456a-474c-b178-acd9f27e8698', 'volume_name': 'volume-e6e47870-456a-474c-b178-acd9f27e8698', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ad010f-5d4f-4bd2-8ecb-f32b2cedb381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ad010f-5d4f-4bd2-8ecb-f32b2cedb381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ae676b-a789-4da8-b49a-06a0e6f9738f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:10 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Volume e6e47870-456a-474c-b178-acd9f27e8698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e47870-456a-474c-b178-acd9f27e8698', 'volume_size': 1} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:10 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0" returned: 0 in 0.672s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.417s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-741205256',display_name='tempest-VolumesGetTest-Volume-429996884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e47870-456a-474c-b178-acd9f27e8698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12796226689647a9885a781985a17a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:10Z,use_quota=True,user_id='2d78cc776a974fb49d06638175565dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Creating volume e6e47870-456a-474c-b178-acd9f27e8698 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:10 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e6e47870-456a-474c-b178-acd9f27e8698 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:10 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e6e47870-456a-474c-b178-acd9f27e8698 1073741824 Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499c7c3f-d3bf-4871-9419-9b4efd2e2145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:10 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6598a186-0b32-4f24-aa13-7f7ad7e30cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:10 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Volume volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 (5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0): created successfully Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6598a186-0b32-4f24-aa13-7f7ad7e30cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Flow 'volume_create_manager' (3d22deb8-5510-49e9-a71f-bdc65ba4646e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:10 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ef0ed49d-ba6c-42fa-955b-09a15dc97e1e tempest-VolumesSnapshotTestJSON-873636441 None] Created volume successfully. Jul 06 12:22:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:11 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e6e47870-456a-474c-b178-acd9f27e8698 1073741824" returned: 0 in 0.868s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e6e47870-456a-474c-b178-acd9f27e8698 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:11 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e6e47870-456a-474c-b178-acd9f27e8698 Jul 06 12:22:11 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:12 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e6e47870-456a-474c-b178-acd9f27e8698" returned: 0 in 0.655s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.994s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ae676b-a789-4da8-b49a-06a0e6f9738f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e47870-456a-474c-b178-acd9f27e8698', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc87d7c-6b11-4db1-b985-4e30ccec5be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] Creating offline snapshot 2f509bbb-8b1d-4dc3-9251-b6eec74b023e of volume 5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:22:12 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Volume volume-e6e47870-456a-474c-b178-acd9f27e8698 (e6e47870-456a-474c-b178-acd9f27e8698): created successfully Jul 06 12:22:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc87d7c-6b11-4db1-b985-4e30ccec5be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Flow 'volume_create_manager' (58647cbc-2075-48d9-b9e9-22941ad93e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:12 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd49a651-41d3-4e3a-81de-188a232370b2]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:12 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c538868e-0564-486c-be56-93645c34c3c0 tempest-VolumesGetTest-1482037949 None] Created volume successfully. Jul 06 12:22:12 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 Jul 06 12:22:12 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:13 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0" returned: 0 in 0.785s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:13 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e 1G Jul 06 12:22:13 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-e6e47870-456a-474c-b178-acd9f27e8698-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Lock "cinder-e6e47870-456a-474c-b178-acd9f27e8698-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-quobyte-e6e47870-456a-474c-b178-acd9f27e8698" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-e6e47870-456a-474c-b178-acd9f27e8698" acquired by "delete_volume" :: waited 0.029s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:13 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bde652-dde6-486e-8082-bd477310ebeb]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e6e47870-456a-474c-b178-acd9f27e8698 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:13 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e6e47870-456a-474c-b178-acd9f27e8698 Jul 06 12:22:13 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:14 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e 1G" returned: 0 in 0.973s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:14 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e Jul 06 12:22:14 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:14 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e6e47870-456a-474c-b178-acd9f27e8698" returned: 0 in 0.973s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e6e47870-456a-474c-b178-acd9f27e8698 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:14 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e6e47870-456a-474c-b178-acd9f27e8698 Jul 06 12:22:14 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:14 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e" returned: 0 in 0.858s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:14 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e is being set with open permissions: ugo+rw Jul 06 12:22:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:14 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e Jul 06 12:22:14 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:15 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e6e47870-456a-474c-b178-acd9f27e8698" returned: 0 in 0.765s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-e6e47870-456a-474c-b178-acd9f27e8698" released by "delete_volume" :: held 1.805s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=92,cinder:SELECT=80,cinder:DELETE=14,cinder:INSERT=20 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=98,cinder:SELECT=80,cinder:INSERT=25,cinder:DELETE=4 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Created reservations ['0cc26baf-6fd3-4a62-b056-addf8dffd48a', 'da5ec180-ea06-4cbc-b854-3ac11485cdd7', 'c9c3b424-7191-4561-a61f-505dfb826d2a', '63fcf0d6-10b7-4581-8e1a-e69ee84bcacb'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:15 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:22:15 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:15 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e" returned: 0 in 0.825s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:15 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.info Jul 06 12:22:15 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-7ed044b5-9af0-49cb-bb57-07a321ca1e23-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Lock "cinder-7ed044b5-9af0-49cb-bb57-07a321ca1e23-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-quobyte-7ed044b5-9af0-49cb-bb57-07a321ca1e23" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-7ed044b5-9af0-49cb-bb57-07a321ca1e23" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:16 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ae713f-fbaf-45c1-836a-e32707760cf4]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:16 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23 Jul 06 12:22:16 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:16 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.849s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:16 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:16 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Deleted volume successfully. Jul 06 12:22:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a93879c7-46f4-4606-86c1-3fbeb684f00e tempest-VolumesGetTest-1482037949 None] Lock "cinder-e6e47870-456a-474c-b178-acd9f27e8698-delete_volume" released by "delete_volume" :: held 2.970s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:16 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.info" returned: 0 in 0.838s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:16 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.info is being set with open permissions: ugo+rw Jul 06 12:22:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:16 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.info Jul 06 12:22:16 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:17 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23" returned: 0 in 0.986s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:17 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23 Jul 06 12:22:17 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:17 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.info" returned: 0 in 0.672s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.099s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:17 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-e2182c2a-b493-4e8d-87a1-d0fb52d4afb0 tempest-VolumesSnapshotTestJSON-873636441 None] Create snapshot completed successfully Jul 06 12:22:17 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7ed044b5-9af0-49cb-bb57-07a321ca1e23" returned: 0 in 0.711s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:17 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-7ed044b5-9af0-49cb-bb57-07a321ca1e23" released by "delete_volume" :: held 1.755s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:17 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Created reservations ['17e6eb03-b4dc-455c-b2f0-a834b572af91', '411b96eb-172b-45ee-9c70-3a095eff320f', '7e9b4321-21f8-4701-8f44-3afac89cadf9', '17e8a236-f098-4781-b0e2-2097dfc7a292'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:17 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:22:17 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Flow 'volume_create_manager' (47eab312-05d8-462c-ae23-ffe78fe64154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7155ce-c903-4a5a-8f26-bcac410e2262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7155ce-c903-4a5a-8f26-bcac410e2262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2125137779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46bc4d59-b9be-4eca-83be-f7b3f6e66f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2534fbbbe314c9185f0376d733a1e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2f509bbb-8b1d-4dc3-9251-b6eec74b023e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:18Z,use_quota=True,user_id='e940a6420ec24a24893e371d1ff11cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39b55ef-d9ca-43e4-8fe7-a1f412f15253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39b55ef-d9ca-43e4-8fe7-a1f412f15253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc680886-4e81-48a8-b9db-d9c27015462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc680886-4e81-48a8-b9db-d9c27015462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '46bc4d59-b9be-4eca-83be-f7b3f6e66f11', 'volume_name': 'volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11', 'volume_size': 1, 'snapshot_id': '2f509bbb-8b1d-4dc3-9251-b6eec74b023e'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe79023-5d8e-4f56-aaa6-6b5c9dd40a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe79023-5d8e-4f56-aaa6-6b5c9dd40a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42f5cf7-e16e-4b1a-a603-19b817930fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:18 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Volume 46bc4d59-b9be-4eca-83be-f7b3f6e66f11: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11', 'volume_size': 1, 'snapshot_id': '2f509bbb-8b1d-4dc3-9251-b6eec74b023e'} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-8fcd71e6-fe3a-4bc4-b596-c953b1746af1-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-quobyte-2f509bbb-8b1d-4dc3-9251-b6eec74b023e-46bc4d59-b9be-4eca-83be-f7b3f6e66f11" by "_create_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Lock "cinder-8fcd71e6-fe3a-4bc4-b596-c953b1746af1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-2f509bbb-8b1d-4dc3-9251-b6eec74b023e-46bc4d59-b9be-4eca-83be-f7b3f6e66f11" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Creating volume 46bc4d59-b9be-4eca-83be-f7b3f6e66f11 from snapshot 2f509bbb-8b1d-4dc3-9251-b6eec74b023e {{(pid=86761) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-quobyte-46bc4d59-b9be-4eca-83be-f7b3f6e66f11" by "_copy_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-46bc4d59-b9be-4eca-83be-f7b3f6e66f11" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] snapshot: 2f509bbb-8b1d-4dc3-9251-b6eec74b023e, volume: 46bc4d59-b9be-4eca-83be-f7b3f6e66f11, {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-quobyte-8fcd71e6-fe3a-4bc4-b596-c953b1746af1" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41068c1-a656-49e6-97f8-9f7343a9df6a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-8fcd71e6-fe3a-4bc4-b596-c953b1746af1" acquired by "delete_volume" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f822bb59-5e38-4ca2-9db3-f63a3f8f7f21]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:18 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e Jul 06 12:22:18 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:18 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 Jul 06 12:22:18 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:18 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.733s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:18 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Deleted volume successfully. Jul 06 12:22:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b9d6036f-9ab7-49cd-81b9-bf5a28cc59a3 tempest-VolumesGetTest-1482037949 None] Lock "cinder-7ed044b5-9af0-49cb-bb57-07a321ca1e23-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:19 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e" returned: 0 in 0.844s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:22:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:22:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Creating direct copy from snapshot {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:22:19 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f202410-ad75-400f-bd41-bf07c8f69aa3]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:19 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1" returned: 0 in 0.886s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:19 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1 Jul 06 12:22:19 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:19 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 Jul 06 12:22:19 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:20 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8fcd71e6-fe3a-4bc4-b596-c953b1746af1" returned: 0 in 0.758s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-8fcd71e6-fe3a-4bc4-b596-c953b1746af1" released by "delete_volume" :: held 1.722s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:20 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0" returned: 0 in 0.949s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:20 devstack cinder-volume[86761]: DEBUG cinder.utils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Path /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11 not found in is_blk_device check {{(pid=86761) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:22:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:20 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Created reservations ['4875cb5a-23bd-4c40-bdef-b2708193dde5', '1f0b5cc3-e937-4254-8767-1af9eb0b1822', '2c95c418-94cf-4bba-a86d-722c4facb37e', 'e0919b9e-3479-4018-b47f-358baad4c57b'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:20 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11 Jul 06 12:22:20 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:20 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:22:20 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:21 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.813s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:21 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:21 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Deleted volume successfully. Jul 06 12:22:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4d2650b3-84a7-4009-ad1b-f98d2875a6e0 tempest-VolumesGetTest-1482037949 None] Lock "cinder-8fcd71e6-fe3a-4bc4-b596-c953b1746af1-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:21 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Flow 'volume_create_manager' (7d771c46-fc10-4f30-ad14-3e73e54dfe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1c7453-e292-4448-b418-2eb6c939eb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1c7453-e292-4448-b418-2eb6c939eb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-289981866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ec344c-359f-4c0c-9135-e0650b117a59,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='12796226689647a9885a781985a17a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:22Z,use_quota=True,user_id='2d78cc776a974fb49d06638175565dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742eca5f-26ac-40bc-93ce-20f2f718b806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742eca5f-26ac-40bc-93ce-20f2f718b806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfc3a61-ec18-4f88-a57d-40b847380570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:22 devstack cinder-volume[86761]: DEBUG cinder.image.glance [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Creating Keystone auth plugin from conf {{(pid=86761) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:22:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfc3a61-ec18-4f88-a57d-40b847380570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31ec344c-359f-4c0c-9135-e0650b117a59', 'volume_name': 'volume-31ec344c-359f-4c0c-9135-e0650b117a59', 'volume_size': 1, 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ecb593f86ab340bf8964e10d312ba960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b808c2-8f1b-479c-81b7-53d2e3206231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b808c2-8f1b-479c-81b7-53d2e3206231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931ec378-ddeb-4a0c-af51-c4f6bf8f95fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:23 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Volume 31ec344c-359f-4c0c-9135-e0650b117a59: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31ec344c-359f-4c0c-9135-e0650b117a59', 'volume_size': 1, 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ecb593f86ab340bf8964e10d312ba960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 12:22:23 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Trying to clone 31ec344c-359f-4c0c-9135-e0650b117a59 from image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]). {{(pid=86761) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:22:23 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_bp2m31dndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:22:23 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Image download 20.69 MB at 20.69 MB/s Jul 06 12:22:23 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b300fb-1c16-4abb-be9d-40392d4ba3bd]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_bp2m31dndevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:24 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_bp2m31dndevstack@QuobyteHD Jul 06 12:22:24 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:25 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_bp2m31dndevstack@QuobyteHD" returned: 0 in 1.872s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:25 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Temporary image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 is fetched for user 2d78cc776a974fb49d06638175565dff. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:22:25 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7360e1-72d3-432d-8ea5-cfa8ea825450]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_bp2m31dndevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:25 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11" returned: 0 in 5.701s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:25 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3c0f51-603c-4a10-b8aa-528a379b0b20]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:26 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_bp2m31dndevstack@QuobyteHD Jul 06 12:22:26 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:26 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 Jul 06 12:22:26 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:26 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_bp2m31dndevstack@QuobyteHD" returned: 0 in 0.825s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:26 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0" returned: 0 in 1.061s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:26 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:22:26 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Converted 1024.00 MB image at 179.57 MB/s Jul 06 12:22:26 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11 is being set with open permissions: ugo+rw Jul 06 12:22:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:27 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11 Jul 06 12:22:27 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:27 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11" returned: 0 in 0.712s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-46bc4d59-b9be-4eca-83be-f7b3f6e66f11" released by "_copy_volume_from_snapshot" :: held 9.380s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-2f509bbb-8b1d-4dc3-9251-b6eec74b023e-46bc4d59-b9be-4eca-83be-f7b3f6e66f11" released by "_create_volume_from_snapshot" :: held 9.427s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.450s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.015s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-289981866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ec344c-359f-4c0c-9135-e0650b117a59,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='12796226689647a9885a781985a17a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:22Z,use_quota=True,user_id='2d78cc776a974fb49d06638175565dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Creating volume 31ec344c-359f-4c0c-9135-e0650b117a59 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:27 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:27 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 1073741824 Jul 06 12:22:27 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42f5cf7-e16e-4b1a-a603-19b817930fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11', 'volume_size': 1, 'snapshot_id': '2f509bbb-8b1d-4dc3-9251-b6eec74b023e'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a07aa3a-7c28-437e-809e-0ca09b793898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:27 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Volume volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11 (46bc4d59-b9be-4eca-83be-f7b3f6e66f11): created successfully Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a07aa3a-7c28-437e-809e-0ca09b793898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Flow 'volume_create_manager' (47eab312-05d8-462c-ae23-ffe78fe64154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:27 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0b245e4f-6bbe-461e-a719-58bbceedc556 tempest-VolumesSnapshotTestJSON-873636441 None] Created volume successfully. Jul 06 12:22:28 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-46bc4d59-b9be-4eca-83be-f7b3f6e66f11-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:28 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-46bc4d59-b9be-4eca-83be-f7b3f6e66f11-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:28 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-quobyte-46bc4d59-b9be-4eca-83be-f7b3f6e66f11" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:28 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-46bc4d59-b9be-4eca-83be-f7b3f6e66f11" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:28 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e92d59-bc22-476d-8a42-26a40f99991d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:28 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11 Jul 06 12:22:28 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:28 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 1073741824" returned: 0 in 0.927s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:28 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 Jul 06 12:22:28 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:29 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11" returned: 0 in 0.845s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:29 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11 Jul 06 12:22:29 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:29 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59" returned: 0 in 0.714s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:29 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Attempting download of 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}])) to volume 31ec344c-359f-4c0c-9135-e0650b117a59. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:22:29 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[380ed560-f6ec-4848-91ba-d249944a5427]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_f_aqcy7q {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:29 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_f_aqcy7q Jul 06 12:22:29 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:29 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-46bc4d59-b9be-4eca-83be-f7b3f6e66f11" returned: 0 in 0.707s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-46bc4d59-b9be-4eca-83be-f7b3f6e66f11" released by "delete_volume" :: held 1.603s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Created reservations ['34d30e3a-6161-4278-b9bd-7b1c425c8c00', '8e3fec4a-87b5-4e44-9dde-9373697f284f', '94498e87-cf34-44ff-ad61-bebbd8c4035a', '4c58881d-cad8-4fd2-9145-d7dd92662623'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:30 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:22:30 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:30 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_f_aqcy7q" returned: 0 in 0.799s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_f_aqcy7q {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:30 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_f_aqcy7q Jul 06 12:22:30 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-2f509bbb-8b1d-4dc3-9251-b6eec74b023e-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-2f509bbb-8b1d-4dc3-9251-b6eec74b023e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-quobyte-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-quobyte-2f509bbb-8b1d-4dc3-9251-b6eec74b023e" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-2f509bbb-8b1d-4dc3-9251-b6eec74b023e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Deleting offline snapshot 2f509bbb-8b1d-4dc3-9251-b6eec74b023e of volume 5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] snapshot_file for this snap is: volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff961cf-18d3-4d81-b5cd-ba5613a62ec5]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:30 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.763s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:30 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Deleted volume successfully. Jul 06 12:22:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3f2cd2ef-95fb-4cd2-91f6-1c8ee99d2862 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-46bc4d59-b9be-4eca-83be-f7b3f6e66f11-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:30 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e Jul 06 12:22:30 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:31 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_f_aqcy7q" returned: 1 in 0.853s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_f_aqcy7q' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:22:31 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbec11c-da94-414e-9342-42e1596c291d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_bp2m31dndevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:31 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_bp2m31dndevstack@QuobyteHD Jul 06 12:22:31 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:31 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e" returned: 0 in 0.848s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:22:31 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[23020a18-821d-4b18-852b-37a64e51984d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:31 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 Jul 06 12:22:31 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:31 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_bp2m31dndevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:31 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 was qcow2, converting to raw {{(pid=86761) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:22:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_bp2m31dndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:31 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_bp2m31dndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 Jul 06 12:22:31 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:32 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0" returned: 0 in 0.850s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:32 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e Jul 06 12:22:32 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:33 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e" returned: 0 in 0.894s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:33 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e Jul 06 12:22:33 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:34 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_bp2m31dndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59" returned: 0 in 2.215s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:34 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_bp2m31dndevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:22:34 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Converted 112.00 MB image at 50.53 MB/s Jul 06 12:22:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:34 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 1G Jul 06 12:22:34 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:34 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0.2f509bbb-8b1d-4dc3-9251-b6eec74b023e" returned: 0 in 0.809s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-2f509bbb-8b1d-4dc3-9251-b6eec74b023e" released by "_delete_snapshot" :: held 3.526s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0" released by "delete_snapshot" :: held 3.571s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:34 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Created reservations ['78ca8f45-03b4-45b1-8ee9-d68e4c3fe5dd', 'd20aa379-aada-4be9-a51f-d864948391fb', '2fb609a2-6c8f-4afb-91be-b41cbc20489f', '1f2a9587-17aa-4d1c-ac07-e382800660d1'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:34 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Delete snapshot completed successfully. Jul 06 12:22:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b0dfcb2e-1964-4e7a-940d-49c29e47972c tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-2f509bbb-8b1d-4dc3-9251-b6eec74b023e-delete_snapshot" released by "delete_snapshot" :: held 3.757s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:34 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 1G" returned: 0 in 0.782s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:34 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5f9aa3-7155-4da7-be76-8d9d03aa7402]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:35 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 Jul 06 12:22:35 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-quobyte-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0" acquired by "delete_volume" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:35 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa73e70-db76-4fb8-9dc0-00f443f7007b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:35 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 Jul 06 12:22:35 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:35 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59" returned: 0 in 0.791s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:35 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 Jul 06 12:22:35 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:35 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0" returned: 0 in 0.808s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:35 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0 Jul 06 12:22:35 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:36 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59" returned: 1 in 0.829s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Downloaded image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}])) to volume 31ec344c-359f-4c0c-9135-e0650b117a59 successfully. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Temporary image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 for user 2d78cc776a974fb49d06638175565dff is deleted. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Marking volume 31ec344c-359f-4c0c-9135-e0650b117a59 as bootable. {{(pid=86761) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Copying metadata from image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 to 31ec344c-359f-4c0c-9135-e0650b117a59. {{(pid=86761) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Creating volume glance metadata for volume 31ec344c-359f-4c0c-9135-e0650b117a59 backed by image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86761) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:22:36 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0" returned: 0 in 0.705s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0" released by "delete_volume" :: held 1.581s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931ec378-ddeb-4a0c-af51-c4f6bf8f95fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ec344c-359f-4c0c-9135-e0650b117a59', 'volume_size': 1, 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ecb593f86ab340bf8964e10d312ba960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09532bc-f934-46eb-a44d-f845f92c3212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:36 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Volume volume-31ec344c-359f-4c0c-9135-e0650b117a59 (31ec344c-359f-4c0c-9135-e0650b117a59): created successfully Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09532bc-f934-46eb-a44d-f845f92c3212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Flow 'volume_create_manager' (7d771c46-fc10-4f30-ad14-3e73e54dfe41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Created reservations ['d91e5a60-0d60-4e8f-b0bb-ae71e91ea30c', 'd208afdc-e7ae-4fe1-ad69-6de2d3a57233', 'a294d586-bbd0-476b-a612-af9c3dcd2693', 'cc9513f0-be50-40cf-8d27-878c079c457f'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:36 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-732f38e4-1643-4323-88d1-e3009fa8ed85 tempest-VolumesGetTest-1482037949 None] Created volume successfully. Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:36 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:22:36 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-e26dbd89-c2b6-4368-a0ff-f27613c4e413-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-e26dbd89-c2b6-4368-a0ff-f27613c4e413-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "cinder-quobyte-e26dbd89-c2b6-4368-a0ff-f27613c4e413" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-e26dbd89-c2b6-4368-a0ff-f27613c4e413" acquired by "delete_volume" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:37 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5433f6a-9c1c-40d6-8527-2d794a0572b0]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:37 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.823s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:37 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:37 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Deleted volume successfully. Jul 06 12:22:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5e2c30fd-5f69-4284-98b8-47a62fd57717 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-5e4dc7f4-ad7f-4d5c-af9a-3e7258698fc0-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:37 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 Jul 06 12:22:37 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Flow 'volume_create_manager' (7a5899be-427f-4b21-9883-3f66badaf33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab2178f-2b8e-4bdd-8720-3b6c373ef99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab2178f-2b8e-4bdd-8720-3b6c373ef99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1625519744',display_name='tempest-VolumesGetTest-Volume-464862272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb884b90-7180-4efd-bc2a-ba85bbd154f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12796226689647a9885a781985a17a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:38Z,use_quota=True,user_id='2d78cc776a974fb49d06638175565dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2663c82c-43e2-46fa-8d63-f45c189a391d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2663c82c-43e2-46fa-8d63-f45c189a391d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d32e2c-123b-411a-868e-ef74b02a5159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d32e2c-123b-411a-868e-ef74b02a5159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb884b90-7180-4efd-bc2a-ba85bbd154f3', 'volume_name': 'volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f993f4-09dd-49bf-9dc1-dedc1750d721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f993f4-09dd-49bf-9dc1-dedc1750d721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25bd9e0-dcd6-4c6c-ada1-92c67696f783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:38 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Volume bb884b90-7180-4efd-bc2a-ba85bbd154f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3', 'volume_size': 1} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1625519744',display_name='tempest-VolumesGetTest-Volume-464862272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb884b90-7180-4efd-bc2a-ba85bbd154f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12796226689647a9885a781985a17a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:38Z,use_quota=True,user_id='2d78cc776a974fb49d06638175565dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Creating volume bb884b90-7180-4efd-bc2a-ba85bbd154f3 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:38 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:38 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3 1073741824 Jul 06 12:22:38 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:38 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413" returned: 0 in 0.941s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:38 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413 Jul 06 12:22:38 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:39 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e26dbd89-c2b6-4368-a0ff-f27613c4e413" returned: 0 in 0.709s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-quobyte-e26dbd89-c2b6-4368-a0ff-f27613c4e413" released by "delete_volume" :: held 1.784s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:39 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Created reservations ['20183d4c-fc45-4383-a23b-c50f116ed626', 'dc61dafb-a490-4b36-a6d6-eeac1a64d12a', 'c063596b-4d3e-489c-a8c5-3bcc0dbd27e8', 'ce2411a4-ffd7-45af-96b0-6664641ddae8'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:39 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3 1073741824" returned: 0 in 0.999s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:39 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:22:39 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:39 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3 Jul 06 12:22:39 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:40 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.823s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:40 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Deleted volume successfully. Jul 06 12:22:40 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3" returned: 0 in 0.814s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c38c5a3a-026a-444f-9121-d9c49f670ce4 tempest-VolumesSnapshotTestJSON-873636441 None] Lock "cinder-e26dbd89-c2b6-4368-a0ff-f27613c4e413-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25bd9e0-dcd6-4c6c-ada1-92c67696f783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86303049-47a5-4814-8438-33d77bf8282b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:40 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Volume volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3 (bb884b90-7180-4efd-bc2a-ba85bbd154f3): created successfully Jul 06 12:22:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86303049-47a5-4814-8438-33d77bf8282b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Flow 'volume_create_manager' (7a5899be-427f-4b21-9883-3f66badaf33c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a027fe68-e686-4791-83a7-a93c9dfc4ea5 tempest-VolumesGetTest-1482037949 None] Created volume successfully. Jul 06 12:22:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-bb884b90-7180-4efd-bc2a-ba85bbd154f3-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Lock "cinder-bb884b90-7180-4efd-bc2a-ba85bbd154f3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-quobyte-bb884b90-7180-4efd-bc2a-ba85bbd154f3" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-bb884b90-7180-4efd-bc2a-ba85bbd154f3" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:41 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[097091eb-84cb-4159-a42b-e31264c2f544]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:42 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3 Jul 06 12:22:42 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:42 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3" returned: 0 in 0.922s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:42 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3 Jul 06 12:22:42 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:43 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-bb884b90-7180-4efd-bc2a-ba85bbd154f3" returned: 0 in 0.884s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-bb884b90-7180-4efd-bc2a-ba85bbd154f3" released by "delete_volume" :: held 1.875s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:43 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Created reservations ['ec33d01a-ac2c-4fad-a98c-ff0daf1deb44', '0fe3a423-36a0-4b30-bf0f-fc5057d6fba1', 'f0bfb7b3-2903-4b7f-8eb0-52e2608da7bd', '5f67e0ba-1a70-4850-805d-470c1ac62ad5'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:43 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:22:43 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-31ec344c-359f-4c0c-9135-e0650b117a59-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Lock "cinder-31ec344c-359f-4c0c-9135-e0650b117a59-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Acquiring lock "cinder-quobyte-31ec344c-359f-4c0c-9135-e0650b117a59" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-31ec344c-359f-4c0c-9135-e0650b117a59" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:44 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e9a957-f5d4-4245-9075-b86188981d8e]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:44 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 Jul 06 12:22:44 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:44 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.017s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:44 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:44 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Deleted volume successfully. Jul 06 12:22:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa008049-1c7e-4aca-a536-0765a13407d2 tempest-VolumesGetTest-1482037949 None] Lock "cinder-bb884b90-7180-4efd-bc2a-ba85bbd154f3-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:45 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59" returned: 0 in 1.073s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:45 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 Jul 06 12:22:45 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:46 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59" returned: 1 in 0.934s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:22:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:46 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59 Jul 06 12:22:46 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:47 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-31ec344c-359f-4c0c-9135-e0650b117a59" returned: 0 in 0.763s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Lock "cinder-quobyte-31ec344c-359f-4c0c-9135-e0650b117a59" released by "delete_volume" :: held 2.876s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:47 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Created reservations ['fb59d825-ba49-484f-a74e-d11cbb6172eb', 'ee01b29e-3e10-4901-8020-9beb17914791', '84859abe-04b0-4b6f-95d6-3a95188b7018', '311cb225-3f8e-40c1-8d49-1249f4e8d62a'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:47 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:22:47 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:48 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.809s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:48 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:48 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Deleted volume successfully. Jul 06 12:22:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-abcb3a6a-1844-4954-b558-71c70d74bdfe tempest-VolumesGetTest-1482037949 None] Lock "cinder-31ec344c-359f-4c0c-9135-e0650b117a59-delete_volume" released by "delete_volume" :: held 3.955s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:22:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:52 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:22:52 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:53 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.935s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:22:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:22:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Flow 'volume_create_manager' (5be7027c-8f53-4d87-8c0a-618a5cf09018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d66b4df-009a-41b1-814e-0a26d9da0ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d66b4df-009a-41b1-814e-0a26d9da0ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1942002571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69f4902-bda4-4621-9158-c1cebb1248e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67ccd860d4f745168df5c8db3bdf40c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:54Z,use_quota=True,user_id='8746d99d93e14f6a834cfb482b95ba1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27fbe52-c232-44bd-be96-c65ef3f8aeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27fbe52-c232-44bd-be96-c65ef3f8aeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f36d7e-0f28-4531-9a4e-3849b45ff657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f36d7e-0f28-4531-9a4e-3849b45ff657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69f4902-bda4-4621-9158-c1cebb1248e6', 'volume_name': 'volume-b69f4902-bda4-4621-9158-c1cebb1248e6', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa721a2-983b-4f95-9a6b-46dfd9c0214b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa721a2-983b-4f95-9a6b-46dfd9c0214b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba310b6a-c9d8-43d5-ad10-e6befa12ae5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:54 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Volume b69f4902-bda4-4621-9158-c1cebb1248e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69f4902-bda4-4621-9158-c1cebb1248e6', 'volume_size': 1} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1942002571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69f4902-bda4-4621-9158-c1cebb1248e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67ccd860d4f745168df5c8db3bdf40c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:54Z,use_quota=True,user_id='8746d99d93e14f6a834cfb482b95ba1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Creating volume b69f4902-bda4-4621-9158-c1cebb1248e6 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:54 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:22:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-b69f4902-bda4-4621-9158-c1cebb1248e6 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:54 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-b69f4902-bda4-4621-9158-c1cebb1248e6 1073741824 Jul 06 12:22:54 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:55 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-b69f4902-bda4-4621-9158-c1cebb1248e6 1073741824" returned: 0 in 1.190s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-b69f4902-bda4-4621-9158-c1cebb1248e6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:55 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-b69f4902-bda4-4621-9158-c1cebb1248e6 Jul 06 12:22:55 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:56 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-b69f4902-bda4-4621-9158-c1cebb1248e6" returned: 0 in 0.751s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba310b6a-c9d8-43d5-ad10-e6befa12ae5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69f4902-bda4-4621-9158-c1cebb1248e6', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2969a0f1-504b-4b2a-9c3b-3de415442877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:56 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Volume volume-b69f4902-bda4-4621-9158-c1cebb1248e6 (b69f4902-bda4-4621-9158-c1cebb1248e6): created successfully Jul 06 12:22:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2969a0f1-504b-4b2a-9c3b-3de415442877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Flow 'volume_create_manager' (5be7027c-8f53-4d87-8c0a-618a5cf09018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:56 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f81499b2-fab0-44b1-b1f1-d0bb09d1c113 tempest-VolumesListTestJSON-1648431823 None] Created volume successfully. Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Flow 'volume_create_manager' (7b5e830f-b125-416b-b04b-39199e6cc831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16682276-c243-4e54-8f3d-9c613bf98045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16682276-c243-4e54-8f3d-9c613bf98045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-784421885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cdef0e-ce8d-4f48-8af1-f293e52dfccf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67ccd860d4f745168df5c8db3bdf40c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:58Z,use_quota=True,user_id='8746d99d93e14f6a834cfb482b95ba1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c631da50-daa2-4c91-b7ba-85e2c977c48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c631da50-daa2-4c91-b7ba-85e2c977c48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77dcc4d1-19bc-4aab-954f-8bf23bcc8a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77dcc4d1-19bc-4aab-954f-8bf23bcc8a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6cdef0e-ce8d-4f48-8af1-f293e52dfccf', 'volume_name': 'volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43ab600-391a-4040-8e85-47a793d9b0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43ab600-391a-4040-8e85-47a793d9b0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb59d89-6a9c-472c-8183-d7eb92258177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:58 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Volume c6cdef0e-ce8d-4f48-8af1-f293e52dfccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf', 'volume_size': 1} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-784421885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cdef0e-ce8d-4f48-8af1-f293e52dfccf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67ccd860d4f745168df5c8db3bdf40c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:58Z,use_quota=True,user_id='8746d99d93e14f6a834cfb482b95ba1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Creating volume c6cdef0e-ce8d-4f48-8af1-f293e52dfccf {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:58 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:22:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:58 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf 1073741824 Jul 06 12:22:58 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:59 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf 1073741824" returned: 0 in 0.956s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:59 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf Jul 06 12:22:59 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:00 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf" returned: 0 in 0.753s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb59d89-6a9c-472c-8183-d7eb92258177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1f0c55-cc63-4fff-a29b-f3f39293e054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:00 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Volume volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf (c6cdef0e-ce8d-4f48-8af1-f293e52dfccf): created successfully Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1f0c55-cc63-4fff-a29b-f3f39293e054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Flow 'volume_create_manager' (7b5e830f-b125-416b-b04b-39199e6cc831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:00 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-34327bb5-6fab-441d-8748-cfd1bbecf60b tempest-VolumesListTestJSON-1648431823 None] Created volume successfully. Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Flow 'volume_create_manager' (c731f144-ee34-44e3-a055-3206626b0f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297aaa31-fe86-4d2e-8ba0-435b164c60c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297aaa31-fe86-4d2e-8ba0-435b164c60c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1572642608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0911a4-1dba-4d61-b800-1b056647e954,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67ccd860d4f745168df5c8db3bdf40c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:01Z,use_quota=True,user_id='8746d99d93e14f6a834cfb482b95ba1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0731d834-5f8d-4836-abf4-e5498b2e968d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0731d834-5f8d-4836-abf4-e5498b2e968d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a490d914-8de1-4b2b-bd0b-c75038d3ca09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a490d914-8de1-4b2b-bd0b-c75038d3ca09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac0911a4-1dba-4d61-b800-1b056647e954', 'volume_name': 'volume-ac0911a4-1dba-4d61-b800-1b056647e954', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8829a9-f77d-4099-86ce-6e9ce82a5770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8829a9-f77d-4099-86ce-6e9ce82a5770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b56e1be-ba5d-41c8-a46a-e5d6fdb5f2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:00 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Volume ac0911a4-1dba-4d61-b800-1b056647e954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac0911a4-1dba-4d61-b800-1b056647e954', 'volume_size': 1} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1572642608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0911a4-1dba-4d61-b800-1b056647e954,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67ccd860d4f745168df5c8db3bdf40c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:01Z,use_quota=True,user_id='8746d99d93e14f6a834cfb482b95ba1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Creating volume ac0911a4-1dba-4d61-b800-1b056647e954 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:23:00 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:23:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0911a4-1dba-4d61-b800-1b056647e954 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:01 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0911a4-1dba-4d61-b800-1b056647e954 1073741824 Jul 06 12:23:01 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:01 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0911a4-1dba-4d61-b800-1b056647e954 1073741824" returned: 0 in 0.952s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0911a4-1dba-4d61-b800-1b056647e954 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:02 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0911a4-1dba-4d61-b800-1b056647e954 Jul 06 12:23:02 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:02 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0911a4-1dba-4d61-b800-1b056647e954" returned: 0 in 0.745s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:02 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:23:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:02 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b56e1be-ba5d-41c8-a46a-e5d6fdb5f2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0911a4-1dba-4d61-b800-1b056647e954', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:02 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9f53c4-5d54-4abc-89f9-9590499305c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:02 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Volume volume-ac0911a4-1dba-4d61-b800-1b056647e954 (ac0911a4-1dba-4d61-b800-1b056647e954): created successfully Jul 06 12:23:02 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9f53c4-5d54-4abc-89f9-9590499305c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:02 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Flow 'volume_create_manager' (c731f144-ee34-44e3-a055-3206626b0f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:02 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-8ba51134-a212-4604-aa35-c992e41930eb tempest-VolumesListTestJSON-1648431823 None] Created volume successfully. Jul 06 12:23:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Acquiring lock "cinder-ac0911a4-1dba-4d61-b800-1b056647e954-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Lock "cinder-ac0911a4-1dba-4d61-b800-1b056647e954-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Acquiring lock "cinder-quobyte-ac0911a4-1dba-4d61-b800-1b056647e954" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Lock "cinder-quobyte-ac0911a4-1dba-4d61-b800-1b056647e954" acquired by "delete_volume" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:05 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f10fba-62dd-4d82-bdde-1ae388b59386]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0911a4-1dba-4d61-b800-1b056647e954 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:05 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0911a4-1dba-4d61-b800-1b056647e954 Jul 06 12:23:05 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:06 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0911a4-1dba-4d61-b800-1b056647e954" returned: 0 in 0.868s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0911a4-1dba-4d61-b800-1b056647e954 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:06 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0911a4-1dba-4d61-b800-1b056647e954 Jul 06 12:23:06 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:07 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ac0911a4-1dba-4d61-b800-1b056647e954" returned: 0 in 0.794s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Lock "cinder-quobyte-ac0911a4-1dba-4d61-b800-1b056647e954" released by "delete_volume" :: held 1.719s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:07 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Created reservations ['01355f14-21a7-4b9c-95c7-44855826c1ae', 'b065aec4-a77b-4606-9ce9-4b166039c09c', '21230fc3-82e8-43b2-8765-5dbe36838e77', 'cae7cbb1-10cb-4be9-a855-847fe6d82f83'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:07 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:23:07 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Acquiring lock "cinder-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Lock "cinder-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Acquiring lock "cinder-quobyte-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Lock "cinder-quobyte-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:08 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b478a53-a822-4ad7-9fc5-d7dad5c25df7]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:08 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf Jul 06 12:23:08 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:08 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.751s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:08 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:08 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Deleted volume successfully. Jul 06 12:23:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-8d95dbf7-605c-43ac-8295-dc4651fbba09 tempest-VolumesListTestJSON-1648431823 None] Lock "cinder-ac0911a4-1dba-4d61-b800-1b056647e954-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:08 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf" returned: 0 in 0.903s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:08 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf Jul 06 12:23:08 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:09 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf" returned: 0 in 0.743s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Lock "cinder-quobyte-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf" released by "delete_volume" :: held 1.715s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:09 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Created reservations ['ee06ed6a-1a61-4090-9347-3c2943050bf0', 'dbd736fa-5b7b-45fc-a9ee-9f235dd2fdb4', '92e2c785-2cf8-4aba-a35b-340eebe33f91', '762c07e5-57b8-432f-92c0-50c06a76904b'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:09 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:23:09 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Acquiring lock "cinder-b69f4902-bda4-4621-9158-c1cebb1248e6-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Lock "cinder-b69f4902-bda4-4621-9158-c1cebb1248e6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Acquiring lock "cinder-quobyte-b69f4902-bda4-4621-9158-c1cebb1248e6" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Lock "cinder-quobyte-b69f4902-bda4-4621-9158-c1cebb1248e6" acquired by "delete_volume" :: waited 0.015s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:10 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[8216f8db-786b-4c2f-8bd8-c9c7590b93d5]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-b69f4902-bda4-4621-9158-c1cebb1248e6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:10 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-b69f4902-bda4-4621-9158-c1cebb1248e6 Jul 06 12:23:10 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:10 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.925s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:10 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:10 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Deleted volume successfully. Jul 06 12:23:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-58b9da64-6363-4f0f-a182-5c381a6d555b tempest-VolumesListTestJSON-1648431823 None] Lock "cinder-c6cdef0e-ce8d-4f48-8af1-f293e52dfccf-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:11 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-b69f4902-bda4-4621-9158-c1cebb1248e6" returned: 0 in 1.114s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-b69f4902-bda4-4621-9158-c1cebb1248e6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:11 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-b69f4902-bda4-4621-9158-c1cebb1248e6 Jul 06 12:23:11 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:12 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-b69f4902-bda4-4621-9158-c1cebb1248e6" returned: 0 in 0.713s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Lock "cinder-quobyte-b69f4902-bda4-4621-9158-c1cebb1248e6" released by "delete_volume" :: held 1.889s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:12 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Created reservations ['a2ea4d8c-6a9a-478a-ac69-03778a028cac', 'c22be294-272e-409d-8948-09d1cb0f2862', 'eaff4776-1acd-4eda-a8c5-5b87ec41db28', '084a251d-5444-487d-a5ff-892029d4645e'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:12 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:23:12 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:13 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.766s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:13 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:13 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Deleted volume successfully. Jul 06 12:23:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7c0f4c9c-d2d6-406a-8116-1aad7923a045 tempest-VolumesListTestJSON-1648431823 None] Lock "cinder-b69f4902-bda4-4621-9158-c1cebb1248e6-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=86,cinder:INSERT=36,cinder:UPDATE=109,cinder:DELETE=8 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:INSERT=31,cinder:UPDATE=117,cinder:SELECT=77,cinder:DELETE=10 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Flow 'volume_create_manager' (70d7a851-a411-42ec-897b-2434de541d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8946e9-3d5a-4586-8b90-ea8e8e3ba57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8946e9-3d5a-4586-8b90-ea8e8e3ba57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1156329427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d0e2e73-2aa7-4f6d-862a-8e5bacab025d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8691817376654f69b64cdd8010cb811f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:16Z,use_quota=True,user_id='a501401977584964955db08e3266934d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08259901-9c6a-41b9-92b6-598c33ff6a04),volume_type_id=08259901-9c6a-41b9-92b6-598c33ff6a04)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfcb2ca-2156-45f6-bcd5-e5e7bdd5ac6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfcb2ca-2156-45f6-bcd5-e5e7bdd5ac6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de6fee2-e5b6-445c-980f-7b727f99336a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de6fee2-e5b6-445c-980f-7b727f99336a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d0e2e73-2aa7-4f6d-862a-8e5bacab025d', 'volume_name': 'volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ab89e4-67bd-42a0-820f-c5cdd16dc4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ab89e4-67bd-42a0-820f-c5cdd16dc4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d37a7c4-11c3-4bda-a6c7-e1aa41193383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:16 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Volume 4d0e2e73-2aa7-4f6d-862a-8e5bacab025d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d', 'volume_size': 1} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1156329427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d0e2e73-2aa7-4f6d-862a-8e5bacab025d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8691817376654f69b64cdd8010cb811f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:16Z,use_quota=True,user_id='a501401977584964955db08e3266934d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08259901-9c6a-41b9-92b6-598c33ff6a04),volume_type_id=08259901-9c6a-41b9-92b6-598c33ff6a04)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Creating volume 4d0e2e73-2aa7-4f6d-862a-8e5bacab025d {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:23:16 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:16 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d 1073741824 Jul 06 12:23:16 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Flow 'volume_create_manager' (3e7eb879-21a2-428f-afea-8cb4327bd2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb65039-013c-43b3-9b10-0baa5b254c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb65039-013c-43b3-9b10-0baa5b254c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1511774549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40df488f-9a89-4f8d-9ff2-fbff3a54bfec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed0f6945edc479e97f4f8b962f03663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:16Z,use_quota=True,user_id='af799f68433744929ed7b2e57201d5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c50ff4-3771-49b6-8a82-3c4d8a6c8b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c50ff4-3771-49b6-8a82-3c4d8a6c8b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef8668a-cd97-450a-99ee-81ec2b4ff496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef8668a-cd97-450a-99ee-81ec2b4ff496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40df488f-9a89-4f8d-9ff2-fbff3a54bfec', 'volume_name': 'volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a074e0a-fa7c-4c27-a6e8-d9bb098f035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a074e0a-fa7c-4c27-a6e8-d9bb098f035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b698fabd-70cc-49da-a3ce-eda3a8de173b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:16 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Volume 40df488f-9a89-4f8d-9ff2-fbff3a54bfec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec', 'volume_size': 1} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Flow 'volume_create_manager' (b82b62a6-7653-4cd8-9eb2-b19765800186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e27b87a-47f2-44aa-8c8e-4e8c6d5fca26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e27b87a-47f2-44aa-8c8e-4e8c6d5fca26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-222568200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8691817376654f69b64cdd8010cb811f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:17Z,use_quota=True,user_id='a501401977584964955db08e3266934d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2154eb71-7589-4038-b6a1-e57274b88090),volume_type_id=2154eb71-7589-4038-b6a1-e57274b88090)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba490f3-b862-411b-8eda-39c5533074c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba490f3-b862-411b-8eda-39c5533074c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0cba30-4418-4174-bc41-0a080d8e45e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0cba30-4418-4174-bc41-0a080d8e45e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3', 'volume_name': 'volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e6699e-c795-4f6a-902a-c64f25467f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e6699e-c795-4f6a-902a-c64f25467f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848cab1b-70bb-4ca6-b54d-3051fac164fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:16 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Volume 35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3', 'volume_size': 1} Jul 06 12:23:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:17 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:23:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Flow 'volume_create_manager' (b2704f2f-cedf-4e6d-971f-8af2a9fe9d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670d0d8d-9a4f-4579-8631-3c716d437822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670d0d8d-9a4f-4579-8631-3c716d437822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-829726478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5629d6a3-85fb-4c7c-adfd-279f9daa4508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8691817376654f69b64cdd8010cb811f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:17Z,use_quota=True,user_id='a501401977584964955db08e3266934d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7619c2ed-6a97-4eb0-b88a-0334e4df22a1),volume_type_id=7619c2ed-6a97-4eb0-b88a-0334e4df22a1)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4b9ed0-e9f5-43a4-b814-106397edd178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4b9ed0-e9f5-43a4-b814-106397edd178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86755e18-5e88-4cef-a385-404da8222847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:17 devstack cinder-volume[86761]: DEBUG cinder.image.glance [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Creating Keystone auth plugin from conf {{(pid=86761) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:23:17 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d 1073741824" returned: 0 in 1.289s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:17 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d Jul 06 12:23:17 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86755e18-5e88-4cef-a385-404da8222847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5629d6a3-85fb-4c7c-adfd-279f9daa4508', 'volume_name': 'volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508', 'volume_size': 1, 'image_id': 'c8e97041-136f-4d31-bbc9-eaa402b0823f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8e97041-136f-4d31-bbc9-eaa402b0823f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1708974415', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8691817376654f69b64cdd8010cb811f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8e97041-136f-4d31-bbc9-eaa402b0823f', 'created_at': datetime.datetime(2026, 7, 6, 10, 23, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 23, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8e97041-136f-4d31-bbc9-eaa402b0823f/file', 'properties': {}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c49996-be58-4424-8888-1a892e556ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c49996-be58-4424-8888-1a892e556ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0a1fa6-255d-4b3b-8dff-cdd795e218c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:17 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Volume 5629d6a3-85fb-4c7c-adfd-279f9daa4508: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508', 'volume_size': 1, 'image_id': 'c8e97041-136f-4d31-bbc9-eaa402b0823f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8e97041-136f-4d31-bbc9-eaa402b0823f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1708974415', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8691817376654f69b64cdd8010cb811f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8e97041-136f-4d31-bbc9-eaa402b0823f', 'created_at': datetime.datetime(2026, 7, 6, 10, 23, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 23, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8e97041-136f-4d31-bbc9-eaa402b0823f/file', 'properties': {}}, 'image_service': } Jul 06 12:23:17 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Trying to clone 5629d6a3-85fb-4c7c-adfd-279f9daa4508 from image c8e97041-136f-4d31-bbc9-eaa402b0823f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c8e97041-136f-4d31-bbc9-eaa402b0823f', 'metadata': {}}]). {{(pid=86761) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:23:18 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d" returned: 0 in 0.908s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] <== create_volume: return (2270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.272s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.970s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1511774549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40df488f-9a89-4f8d-9ff2-fbff3a54bfec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed0f6945edc479e97f4f8b962f03663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:16Z,use_quota=True,user_id='af799f68433744929ed7b2e57201d5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Creating volume 40df488f-9a89-4f8d-9ff2-fbff3a54bfec {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:23:18 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:18 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec 1073741824 Jul 06 12:23:18 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d37a7c4-11c3-4bda-a6c7-e1aa41193383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7416b0d6-f756-4be1-9202-7c7b8eb32c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:18 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Volume volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d (4d0e2e73-2aa7-4f6d-862a-8e5bacab025d): created successfully Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7416b0d6-f756-4be1-9202-7c7b8eb32c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Flow 'volume_create_manager' (70d7a851-a411-42ec-897b-2434de541d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:18 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c0cd39d3-9bf6-4fc3-b27a-31904d98d3db tempest-TestInstancesWithCinderVolumes-1907871535 None] Created volume successfully. Jul 06 12:23:19 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec 1073741824" returned: 0 in 1.178s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:19 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec Jul 06 12:23:19 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:20 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" returned: 0 in 0.864s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] <== create_volume: return (2141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.145s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.988s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-222568200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8691817376654f69b64cdd8010cb811f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:17Z,use_quota=True,user_id='a501401977584964955db08e3266934d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2154eb71-7589-4038-b6a1-e57274b88090),volume_type_id=2154eb71-7589-4038-b6a1-e57274b88090)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Creating volume 35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:23:20 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:20 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3 1073741824 Jul 06 12:23:20 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b698fabd-70cc-49da-a3ce-eda3a8de173b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7dd2ea-a985-4a0a-836c-4d873f3782d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:20 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Volume volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec (40df488f-9a89-4f8d-9ff2-fbff3a54bfec): created successfully Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7dd2ea-a985-4a0a-836c-4d873f3782d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Flow 'volume_create_manager' (3e7eb879-21a2-428f-afea-8cb4327bd2c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:20 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-8c38cbe3-6023-40d1-80c0-ec5bc541fd76 tempest-VolumesSnapshotListTestJSON-2019714453 None] Created volume successfully. Jul 06 12:23:21 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c8e97041-136f-4d31-bbc9-eaa402b0823f_v9n6ma20devstack@QuobyteHD, size 20.69 MB, duration 3.90 sec {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:23:21 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Image download 20.69 MB at 5.30 MB/s Jul 06 12:23:21 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72a5c09-7ecb-4f65-a284-8b020d768d04]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8e97041-136f-4d31-bbc9-eaa402b0823f_v9n6ma20devstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:22 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3 1073741824" returned: 0 in 1.207s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:22 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8e97041-136f-4d31-bbc9-eaa402b0823f_v9n6ma20devstack@QuobyteHD Jul 06 12:23:22 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:22 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3 Jul 06 12:23:22 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:22 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3" returned: 0 in 0.696s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.783s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848cab1b-70bb-4ca6-b54d-3051fac164fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e745ca39-9177-4729-9fce-6bd3e97471ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] Creating offline snapshot bbb45a9f-846a-430e-b165-12c9d1ea471a of volume 40df488f-9a89-4f8d-9ff2-fbff3a54bfec {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:23:22 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Volume volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3 (35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3): created successfully Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e745ca39-9177-4729-9fce-6bd3e97471ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:22 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Flow 'volume_create_manager' (b82b62a6-7653-4cd8-9eb2-b19765800186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f243b64a-0ff1-440e-b46e-518eae2742fc]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8e97041-136f-4d31-bbc9-eaa402b0823f_v9n6ma20devstack@QuobyteHD" returned: 0 in 0.925s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Temporary image c8e97041-136f-4d31-bbc9-eaa402b0823f is fetched for user a501401977584964955db08e3266934d. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:23:22 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-122061e4-eb83-416a-be93-a87b82c11191 tempest-TestInstancesWithCinderVolumes-1907871535 None] Created volume successfully. Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[693015c4-8a39-437c-a9c2-fdf742c6c3fa]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8e97041-136f-4d31-bbc9-eaa402b0823f_v9n6ma20devstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:22 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec Jul 06 12:23:22 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:23 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8e97041-136f-4d31-bbc9-eaa402b0823f_v9n6ma20devstack@QuobyteHD Jul 06 12:23:23 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:23 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" returned: 0 in 0.810s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:23 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a 1G Jul 06 12:23:23 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:23 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8e97041-136f-4d31-bbc9-eaa402b0823f_v9n6ma20devstack@QuobyteHD" returned: 0 in 0.769s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:24 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a 1G" returned: 0 in 0.901s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:24 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a Jul 06 12:23:24 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:25 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a" returned: 0 in 0.759s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:25 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a is being set with open permissions: ugo+rw Jul 06 12:23:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:25 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a Jul 06 12:23:25 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:26 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a" returned: 0 in 0.731s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:26 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.info Jul 06 12:23:26 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:26 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.info" returned: 0 in 0.702s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:26 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.info is being set with open permissions: ugo+rw Jul 06 12:23:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:26 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.info Jul 06 12:23:26 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:27 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.info" returned: 0 in 0.664s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.698s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.766s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-829726478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5629d6a3-85fb-4c7c-adfd-279f9daa4508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8691817376654f69b64cdd8010cb811f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:17Z,use_quota=True,user_id='a501401977584964955db08e3266934d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7619c2ed-6a97-4eb0-b88a-0334e4df22a1),volume_type_id=7619c2ed-6a97-4eb0-b88a-0334e4df22a1)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:23:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Creating volume 5629d6a3-85fb-4c7c-adfd-279f9daa4508 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:23:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:23:27 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:23:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:27 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 1073741824 Jul 06 12:23:27 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:27 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-05e98247-ca8e-4b00-aa75-2feeb8153aa7 tempest-VolumesSnapshotListTestJSON-2019714453 None] Create snapshot completed successfully Jul 06 12:23:28 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 1073741824" returned: 0 in 0.923s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:28 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 Jul 06 12:23:28 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-78c9623d-856b-49e3-90d9-67a6140c2443 tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:29 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508" returned: 0 in 0.781s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:23:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-78c9623d-856b-49e3-90d9-67a6140c2443 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.747s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-78c9623d-856b-49e3-90d9-67a6140c2443 tempest-VolumesSnapshotListTestJSON-2019714453 None] Creating offline snapshot 31067636-ba8c-45ce-9ec6-413fee1d603a of volume 40df488f-9a89-4f8d-9ff2-fbff3a54bfec {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:23:29 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Attempting download of c8e97041-136f-4d31-bbc9-eaa402b0823f ((None, [{'url': 'file:///opt/stack/data/glance/images/c8e97041-136f-4d31-bbc9-eaa402b0823f', 'metadata': {}}])) to volume 5629d6a3-85fb-4c7c-adfd-279f9daa4508. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:23:29 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba37a37c-dc22-4b97-ab7b-8c6938494a9a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78c9623d-856b-49e3-90d9-67a6140c2443 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:29 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3a8bec-57d9-4e2b-a7c7-b5189aec7b67]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8e97041-136f-4d31-bbc9-eaa402b0823f_4cln2ryi {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:29 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a Jul 06 12:23:29 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:29 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8e97041-136f-4d31-bbc9-eaa402b0823f_4cln2ryi Jul 06 12:23:29 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:30 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78c9623d-856b-49e3-90d9-67a6140c2443 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a" returned: 0 in 0.795s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-78c9623d-856b-49e3-90d9-67a6140c2443 tempest-VolumesSnapshotListTestJSON-2019714453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:23:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78c9623d-856b-49e3-90d9-67a6140c2443 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:30 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a 1G Jul 06 12:23:30 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:30 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8e97041-136f-4d31-bbc9-eaa402b0823f_4cln2ryi" returned: 0 in 0.805s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8e97041-136f-4d31-bbc9-eaa402b0823f_4cln2ryi {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:30 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8e97041-136f-4d31-bbc9-eaa402b0823f_4cln2ryi Jul 06 12:23:30 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:31 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8e97041-136f-4d31-bbc9-eaa402b0823f_4cln2ryi" returned: 1 in 0.896s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8e97041-136f-4d31-bbc9-eaa402b0823f_4cln2ryi' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:23:31 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d7f063-923b-4b26-98d2-3443c130060a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8e97041-136f-4d31-bbc9-eaa402b0823f_v9n6ma20devstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:31 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78c9623d-856b-49e3-90d9-67a6140c2443 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a 1G" returned: 0 in 1.036s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78c9623d-856b-49e3-90d9-67a6140c2443 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:31 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a Jul 06 12:23:31 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:31 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8e97041-136f-4d31-bbc9-eaa402b0823f_v9n6ma20devstack@QuobyteHD Jul 06 12:23:31 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:31 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8e97041-136f-4d31-bbc9-eaa402b0823f_v9n6ma20devstack@QuobyteHD" returned: 0 in 0.869s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:31 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] c8e97041-136f-4d31-bbc9-eaa402b0823f was qcow2, converting to raw {{(pid=86761) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:23:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8e97041-136f-4d31-bbc9-eaa402b0823f_v9n6ma20devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:31 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78c9623d-856b-49e3-90d9-67a6140c2443 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a" returned: 0 in 0.816s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:31 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-78c9623d-856b-49e3-90d9-67a6140c2443 tempest-VolumesSnapshotListTestJSON-2019714453 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a is being set with open permissions: ugo+rw Jul 06 12:23:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78c9623d-856b-49e3-90d9-67a6140c2443 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:31 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8e97041-136f-4d31-bbc9-eaa402b0823f_v9n6ma20devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 Jul 06 12:23:31 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:31 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a Jul 06 12:23:31 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:32 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78c9623d-856b-49e3-90d9-67a6140c2443 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a" returned: 0 in 0.789s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-78c9623d-856b-49e3-90d9-67a6140c2443 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.560s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:32 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-78c9623d-856b-49e3-90d9-67a6140c2443 tempest-VolumesSnapshotListTestJSON-2019714453 None] Create snapshot completed successfully Jul 06 12:23:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c7b8c19a-0947-4f37-a10f-92ce49e80e1d tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c7b8c19a-0947-4f37-a10f-92ce49e80e1d tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:34 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c7b8c19a-0947-4f37-a10f-92ce49e80e1d tempest-VolumesSnapshotListTestJSON-2019714453 None] Creating offline snapshot a30c0368-cc2c-4f51-8138-7f88469bc50f of volume 40df488f-9a89-4f8d-9ff2-fbff3a54bfec {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:23:34 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b444fb-b452-475e-897c-bfcd09b4afa6]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c7b8c19a-0947-4f37-a10f-92ce49e80e1d tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:34 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a Jul 06 12:23:34 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:34 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8e97041-136f-4d31-bbc9-eaa402b0823f_v9n6ma20devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508" returned: 0 in 2.336s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:34 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c8e97041-136f-4d31-bbc9-eaa402b0823f_v9n6ma20devstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:23:34 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Converted 112.00 MB image at 47.91 MB/s Jul 06 12:23:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:34 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 1G Jul 06 12:23:34 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:34 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c7b8c19a-0947-4f37-a10f-92ce49e80e1d tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a" returned: 0 in 0.886s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:34 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c7b8c19a-0947-4f37-a10f-92ce49e80e1d tempest-VolumesSnapshotListTestJSON-2019714453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:23:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c7b8c19a-0947-4f37-a10f-92ce49e80e1d tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:35 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f 1G Jul 06 12:23:35 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:35 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 1G" returned: 0 in 0.829s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:35 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[310527f8-11d4-47a7-980d-296fa0e6f644]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:35 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 Jul 06 12:23:35 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:36 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508" returned: 0 in 0.921s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:36 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c7b8c19a-0947-4f37-a10f-92ce49e80e1d tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f 1G" returned: 0 in 1.144s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c7b8c19a-0947-4f37-a10f-92ce49e80e1d tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:36 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f Jul 06 12:23:36 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:36 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 Jul 06 12:23:36 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:36 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c7b8c19a-0947-4f37-a10f-92ce49e80e1d tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f" returned: 0 in 0.776s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:36 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-c7b8c19a-0947-4f37-a10f-92ce49e80e1d tempest-VolumesSnapshotListTestJSON-2019714453 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f is being set with open permissions: ugo+rw Jul 06 12:23:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c7b8c19a-0947-4f37-a10f-92ce49e80e1d tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:36 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f Jul 06 12:23:36 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:36 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508" returned: 1 in 0.868s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:23:36 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Downloaded image c8e97041-136f-4d31-bbc9-eaa402b0823f ((None, [{'url': 'file:///opt/stack/data/glance/images/c8e97041-136f-4d31-bbc9-eaa402b0823f', 'metadata': {}}])) to volume 5629d6a3-85fb-4c7c-adfd-279f9daa4508 successfully. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:23:36 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Temporary image c8e97041-136f-4d31-bbc9-eaa402b0823f for user a501401977584964955db08e3266934d is deleted. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:23:36 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Marking volume 5629d6a3-85fb-4c7c-adfd-279f9daa4508 as bootable. {{(pid=86761) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:23:36 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Copying metadata from image c8e97041-136f-4d31-bbc9-eaa402b0823f to 5629d6a3-85fb-4c7c-adfd-279f9daa4508. {{(pid=86761) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:23:36 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Creating volume glance metadata for volume 5629d6a3-85fb-4c7c-adfd-279f9daa4508 backed by image c8e97041-136f-4d31-bbc9-eaa402b0823f with: {'image_id': 'c8e97041-136f-4d31-bbc9-eaa402b0823f', 'image_name': 'tempest-scenario-img--1708974415', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86761) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:23:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0a1fa6-255d-4b3b-8dff-cdd795e218c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508', 'volume_size': 1, 'image_id': 'c8e97041-136f-4d31-bbc9-eaa402b0823f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8e97041-136f-4d31-bbc9-eaa402b0823f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1708974415', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8691817376654f69b64cdd8010cb811f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8e97041-136f-4d31-bbc9-eaa402b0823f', 'created_at': datetime.datetime(2026, 7, 6, 10, 23, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 23, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8e97041-136f-4d31-bbc9-eaa402b0823f/file', 'properties': {}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66fc8ba5-1ba6-446f-b0ea-ba22f34e8f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:37 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Volume volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 (5629d6a3-85fb-4c7c-adfd-279f9daa4508): created successfully Jul 06 12:23:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66fc8ba5-1ba6-446f-b0ea-ba22f34e8f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Flow 'volume_create_manager' (b2704f2f-cedf-4e6d-971f-8af2a9fe9d3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:37 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ac61ce2f-9a6d-4006-aa90-f92d80ffc056 tempest-TestInstancesWithCinderVolumes-1907871535 None] Created volume successfully. Jul 06 12:23:37 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c7b8c19a-0947-4f37-a10f-92ce49e80e1d tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f" returned: 0 in 0.751s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c7b8c19a-0947-4f37-a10f-92ce49e80e1d tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.677s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:37 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c7b8c19a-0947-4f37-a10f-92ce49e80e1d tempest-VolumesSnapshotListTestJSON-2019714453 None] Create snapshot completed successfully Jul 06 12:23:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "cinder-a30c0368-cc2c-4f51-8138-7f88469bc50f-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-a30c0368-cc2c-4f51-8138-7f88469bc50f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "cinder-quobyte-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-quobyte-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "cinder-quobyte-a30c0368-cc2c-4f51-8138-7f88469bc50f" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-quobyte-a30c0368-cc2c-4f51-8138-7f88469bc50f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Deleting offline snapshot a30c0368-cc2c-4f51-8138-7f88469bc50f of volume 40df488f-9a89-4f8d-9ff2-fbff3a54bfec {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:23:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] snapshot_file for this snap is: volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:23:39 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c704a8bc-c5f1-4d7d-9354-9cda965fdf8c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:39 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f Jul 06 12:23:39 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:40 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f" returned: 0 in 0.955s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:23:40 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad003c9d-9e2d-4794-bda2-c52a407c19bf]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:40 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a Jul 06 12:23:40 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:41 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a" returned: 0 in 0.914s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:23:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:41 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f Jul 06 12:23:41 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:42 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f" returned: 0 in 0.991s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:42 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f Jul 06 12:23:42 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:42 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.a30c0368-cc2c-4f51-8138-7f88469bc50f" returned: 0 in 0.764s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-quobyte-a30c0368-cc2c-4f51-8138-7f88469bc50f" released by "_delete_snapshot" :: held 3.736s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-quobyte-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" released by "delete_snapshot" :: held 3.766s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:43 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Created reservations ['1330f6ed-e26f-4ae9-9405-6ebe5735e525', 'c7fdcb2c-ef98-4727-bff2-584a86633a42', 'ff4a3030-80ef-482b-8623-c4f199895266', '927a2364-8462-46a7-bc1e-7656da3dcc7e'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:43 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Delete snapshot completed successfully. Jul 06 12:23:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-eec39e6a-f81c-4b8a-9580-d2103b16fe2e tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-a30c0368-cc2c-4f51-8138-7f88469bc50f-delete_snapshot" released by "delete_snapshot" :: held 3.924s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "cinder-31067636-ba8c-45ce-9ec6-413fee1d603a-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-31067636-ba8c-45ce-9ec6-413fee1d603a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "cinder-quobyte-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-quobyte-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "cinder-quobyte-31067636-ba8c-45ce-9ec6-413fee1d603a" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-quobyte-31067636-ba8c-45ce-9ec6-413fee1d603a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Deleting offline snapshot 31067636-ba8c-45ce-9ec6-413fee1d603a of volume 40df488f-9a89-4f8d-9ff2-fbff3a54bfec {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:23:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] snapshot_file for this snap is: volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:23:43 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[33874f64-a881-4741-980e-637f8aa32df5]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:43 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a Jul 06 12:23:43 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:44 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a" returned: 0 in 0.873s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:44 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:23:44 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb90abf8-dc97-4699-b920-74c9fade630f]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:44 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a Jul 06 12:23:44 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:45 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a" returned: 0 in 0.894s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:23:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:45 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a Jul 06 12:23:45 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:46 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a" returned: 0 in 0.995s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:46 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a Jul 06 12:23:46 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:47 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.31067636-ba8c-45ce-9ec6-413fee1d603a" returned: 0 in 1.014s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-quobyte-31067636-ba8c-45ce-9ec6-413fee1d603a" released by "_delete_snapshot" :: held 3.921s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-quobyte-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" released by "delete_snapshot" :: held 3.950s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Created reservations ['44bd6e69-83d6-4b32-a52d-29f9a980ebda', '91cfa5ee-288d-40e0-a090-09b3c28a990f', 'a795541d-2259-4917-b551-838b2a7ceec5', '5b750391-f577-450b-ac98-f24c88964bab'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:47 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Delete snapshot completed successfully. Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ec3425a3-0927-4e9b-8873-40945c36dd53 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-31067636-ba8c-45ce-9ec6-413fee1d603a-delete_snapshot" released by "delete_snapshot" :: held 4.200s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "cinder-bbb45a9f-846a-430e-b165-12c9d1ea471a-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-bbb45a9f-846a-430e-b165-12c9d1ea471a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "cinder-quobyte-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-80b26d62-7579-4937-839c-9f6e637ab7fc req-c1f033fa-0847-4e7a-bc5e-2a492fa3b7d7 tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-80b26d62-7579-4937-839c-9f6e637ab7fc req-c1f033fa-0847-4e7a-bc5e-2a492fa3b7d7 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-quobyte-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "cinder-quobyte-bbb45a9f-846a-430e-b165-12c9d1ea471a" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-quobyte-bbb45a9f-846a-430e-b165-12c9d1ea471a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Deleting offline snapshot bbb45a9f-846a-430e-b165-12c9d1ea471a of volume 40df488f-9a89-4f8d-9ff2-fbff3a54bfec {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] snapshot_file for this snap is: volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b9a1ee-faac-420f-b453-135cdc49266d]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-80b26d62-7579-4937-839c-9f6e637ab7fc req-c1f033fa-0847-4e7a-bc5e-2a492fa3b7d7 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca5d228-a914-411c-8ae5-0af124935abf]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:48 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 Jul 06 12:23:48 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:48 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a Jul 06 12:23:48 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:49 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-80b26d62-7579-4937-839c-9f6e637ab7fc req-c1f033fa-0847-4e7a-bc5e-2a492fa3b7d7 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508" returned: 0 in 1.067s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-80b26d62-7579-4937-839c-9f6e637ab7fc req-c1f033fa-0847-4e7a-bc5e-2a492fa3b7d7 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:49 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a" returned: 0 in 1.189s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:23:49 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 Jul 06 12:23:49 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:49 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[4231f9a8-fe7c-4a61-9e1f-cbc48ea55ae7]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:49 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec Jul 06 12:23:49 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:49 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-80b26d62-7579-4937-839c-9f6e637ab7fc req-c1f033fa-0847-4e7a-bc5e-2a492fa3b7d7 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508" returned: 1 in 0.927s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-80b26d62-7579-4937-839c-9f6e637ab7fc req-c1f033fa-0847-4e7a-bc5e-2a492fa3b7d7 tempest-TestInstancesWithCinderVolumes-1907871535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:23:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-80b26d62-7579-4937-839c-9f6e637ab7fc req-c1f033fa-0847-4e7a-bc5e-2a492fa3b7d7 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.080s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-80b26d62-7579-4937-839c-9f6e637ab7fc req-c1f033fa-0847-4e7a-bc5e-2a492fa3b7d7 tempest-TestInstancesWithCinderVolumes-1907871535 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61ea6437-bf44-4512-baf0-30559f725c7c', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:23:50 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-80b26d62-7579-4937-839c-9f6e637ab7fc req-c1f033fa-0847-4e7a-bc5e-2a492fa3b7d7 tempest-TestInstancesWithCinderVolumes-1907871535 None] attachment_update completed successfully. Jul 06 12:23:50 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" returned: 0 in 0.987s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:50 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a Jul 06 12:23:50 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:51 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a" returned: 0 in 0.964s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:51 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a Jul 06 12:23:51 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:51 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec.bbb45a9f-846a-430e-b165-12c9d1ea471a" returned: 0 in 0.718s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-quobyte-bbb45a9f-846a-430e-b165-12c9d1ea471a" released by "_delete_snapshot" :: held 4.014s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-quobyte-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" released by "delete_snapshot" :: held 4.044s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:52 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Created reservations ['362f16a0-6312-419a-b072-3c00651901b7', '0222633b-0dd4-4346-ad35-929186e31803', '266fe1ec-15f0-4a23-ae61-f9cede9155e4', '18634320-fc18-4713-8426-31833ae3f2d5'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:52 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Delete snapshot completed successfully. Jul 06 12:23:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab1b303c-1350-49c9-9d92-6777c5cbfac1 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-bbb45a9f-846a-430e-b165-12c9d1ea471a-delete_snapshot" released by "delete_snapshot" :: held 4.263s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:23:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:52 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:23:52 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "cinder-40df488f-9a89-4f8d-9ff2-fbff3a54bfec-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-40df488f-9a89-4f8d-9ff2-fbff3a54bfec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "cinder-quobyte-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-quobyte-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:53 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.840s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:23:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:23:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:23:53 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afbe4b9-e652-41fd-bdc6-87baf6c22e46]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:53 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec Jul 06 12:23:53 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:54 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" returned: 0 in 1.161s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:54 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec Jul 06 12:23:54 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:55 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" returned: 0 in 0.784s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-quobyte-40df488f-9a89-4f8d-9ff2-fbff3a54bfec" released by "delete_volume" :: held 2.043s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:55 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Created reservations ['68fe0141-17ae-431e-ae10-8dcd5f6478a4', '84f2a637-a9d2-49f4-b24b-6931f0007a7d', 'bae042d6-6f2a-48bb-8f88-0e1a5a6ceb7e', '0439507b-6e3e-4c9b-a022-fa0c1502db8a'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:55 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:23:55 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:56 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.688s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:56 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:56 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Deleted volume successfully. Jul 06 12:23:56 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ca0a7dbd-457b-4fb1-a792-b1890f683336 tempest-VolumesSnapshotListTestJSON-2019714453 None] Lock "cinder-40df488f-9a89-4f8d-9ff2-fbff3a54bfec-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:05 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=48,cinder:UPDATE=42,cinder:DELETE=6,cinder:INSERT=14 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:24:06 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=46,cinder:UPDATE=44,cinder:INSERT=16,cinder:DELETE=2 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:24:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-5ececce2-e4cc-4005-a1a3-b0ada5924529 req-af707358-ae00-40b2-a22a-c2fb4f398ecb tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-5ececce2-e4cc-4005-a1a3-b0ada5924529 req-af707358-ae00-40b2-a22a-c2fb4f398ecb tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:30 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ec0535-a99b-48ee-8a81-60c97fad3c12]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-5ececce2-e4cc-4005-a1a3-b0ada5924529 req-af707358-ae00-40b2-a22a-c2fb4f398ecb tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:30 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d Jul 06 12:24:30 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:31 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-5ececce2-e4cc-4005-a1a3-b0ada5924529 req-af707358-ae00-40b2-a22a-c2fb4f398ecb tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d" returned: 0 in 0.796s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-5ececce2-e4cc-4005-a1a3-b0ada5924529 req-af707358-ae00-40b2-a22a-c2fb4f398ecb tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.814s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-5ececce2-e4cc-4005-a1a3-b0ada5924529 req-af707358-ae00-40b2-a22a-c2fb4f398ecb tempest-TestInstancesWithCinderVolumes-1907871535 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e194fea5-55cf-441a-aaa4-695d5b6dc51e', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:24:31 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-5ececce2-e4cc-4005-a1a3-b0ada5924529 req-af707358-ae00-40b2-a22a-c2fb4f398ecb tempest-TestInstancesWithCinderVolumes-1907871535 None] attachment_update completed successfully. Jul 06 12:24:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-9a19803c-3312-4b23-b7eb-06631f1ed05b req-862cfe00-2d2e-49a4-84f1-e613fa7aef26 tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-9a19803c-3312-4b23-b7eb-06631f1ed05b req-862cfe00-2d2e-49a4-84f1-e613fa7aef26 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:39 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda69865-b3c7-4e4c-888f-cfc2cd5ad257]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-9a19803c-3312-4b23-b7eb-06631f1ed05b req-862cfe00-2d2e-49a4-84f1-e613fa7aef26 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:39 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3 Jul 06 12:24:39 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:40 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-9a19803c-3312-4b23-b7eb-06631f1ed05b req-862cfe00-2d2e-49a4-84f1-e613fa7aef26 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3" returned: 0 in 1.129s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-9a19803c-3312-4b23-b7eb-06631f1ed05b req-862cfe00-2d2e-49a4-84f1-e613fa7aef26 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.194s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-9a19803c-3312-4b23-b7eb-06631f1ed05b req-862cfe00-2d2e-49a4-84f1-e613fa7aef26 tempest-TestInstancesWithCinderVolumes-1907871535 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ada8c456-3aac-49d7-a060-bf265efa0fb5', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:24:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-9a19803c-3312-4b23-b7eb-06631f1ed05b req-862cfe00-2d2e-49a4-84f1-e613fa7aef26 tempest-TestInstancesWithCinderVolumes-1907871535 None] attachment_update completed successfully. Jul 06 12:24:50 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=15,cinder:UPDATE=2 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:24:50 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:24:50 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-b306c879-72dc-4fd0-a555-300306095a64 req-d912662e-6287-46a5-b4b6-5c428716e2d2 tempest-TestInstancesWithCinderVolumes-1907871535 None] Terminate volume connection completed successfully. Jul 06 12:24:50 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-b306c879-72dc-4fd0-a555-300306095a64 req-d912662e-6287-46a5-b4b6-5c428716e2d2 tempest-TestInstancesWithCinderVolumes-1907871535 None] Deleting attachment e194fea5-55cf-441a-aaa4-695d5b6dc51e. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:24:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:24:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:52 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:24:52 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "cinder-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "cinder-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "cinder-quobyte-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "cinder-quobyte-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:52 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf3b516-23a9-45bc-ae7a-fa13669988a2]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:52 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d Jul 06 12:24:52 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:53 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.096s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:24:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:24:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:24:53 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d" returned: 0 in 0.955s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:53 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d Jul 06 12:24:53 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:54 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d" returned: 0 in 0.831s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "cinder-quobyte-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d" released by "delete_volume" :: held 1.849s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:54 devstack cinder-volume[86761]: WARNING cinder.quota [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1444850156-1166226966 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1444850156-1166226966, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:24:54 devstack cinder-volume[86761]: WARNING cinder.quota [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1444850156-1166226966 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1444850156-1166226966, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:24:54 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Created reservations ['160ff638-29b2-4b84-9288-48eda03be95f', '823b5654-2c7e-4aff-9c5a-7f19c3ae3b83', 'e2feb6a6-48e0-4cac-a619-6ddb4d6776d6', '9cbbcef8-3c6d-4af7-84f1-b8166e7f0c4f'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:54 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:24:54 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:55 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.738s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:55 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:55 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Deleted volume successfully. Jul 06 12:24:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-26034afe-ed7e-43cb-b3b5-3a10fce7d159 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "cinder-4d0e2e73-2aa7-4f6d-862a-8e5bacab025d-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:57 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-2d866bf3-a467-4917-9b15-06b5a07f5d0c req-8a395511-9db5-4ef6-a2d6-68bfca293b88 tempest-TestInstancesWithCinderVolumes-1907871535 None] Terminate volume connection completed successfully. Jul 06 12:24:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-2d866bf3-a467-4917-9b15-06b5a07f5d0c req-8a395511-9db5-4ef6-a2d6-68bfca293b88 tempest-TestInstancesWithCinderVolumes-1907871535 None] Deleting attachment ada8c456-3aac-49d7-a060-bf265efa0fb5. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:24:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "cinder-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "cinder-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "cinder-quobyte-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "cinder-quobyte-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3" acquired by "delete_volume" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:00 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d243649b-c056-4a59-a03c-947613e44702]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:00 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3 Jul 06 12:25:00 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3" returned: 0 in 0.993s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:01 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:01 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3 Jul 06 12:25:01 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:01 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3" returned: 0 in 0.878s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "cinder-quobyte-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3" released by "delete_volume" :: held 1.946s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:02 devstack cinder-volume[86761]: WARNING cinder.quota [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-560662331-402691186 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-560662331-402691186, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:25:02 devstack cinder-volume[86761]: WARNING cinder.quota [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-560662331-402691186 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-560662331-402691186, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:25:02 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Created reservations ['fae7a4f8-b29d-45a4-bab7-84a8d820c119', '4d827520-6c62-4f6e-9147-d36ee2d4e61c', '9c812875-1fc8-4a3b-8b41-e318329a8b6c', '234717db-e931-4144-8cd6-8cda0059512f'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:02 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:02 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:02 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:25:02 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:03 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.998s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:03 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:25:03 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Deleted volume successfully. Jul 06 12:25:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f544648d-a51c-4f0e-b812-dc2394bddc30 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "cinder-35f0fcc0-f8a9-4bd2-a1dc-4ce8ca89d0c3-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Flow 'volume_create_manager' (ff6716de-7cd0-41d3-9fc9-acab8f56c93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ab2b51-60b1-48be-ac13-7e21a0f4978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ab2b51-60b1-48be-ac13-7e21a0f4978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1701837006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b5cefb-0c36-49a6-aded-f93aafd93511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba2cfac6310452caf01fbefce96e7fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:25:06Z,use_quota=True,user_id='d707eba2882445eeb77b70a8737543be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (352b3279-a873-4f22-90a3-3105d57ed346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (352b3279-a873-4f22-90a3-3105d57ed346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169076b6-9907-4402-8c48-e94f9aada9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169076b6-9907-4402-8c48-e94f9aada9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b5cefb-0c36-49a6-aded-f93aafd93511', 'volume_name': 'volume-24b5cefb-0c36-49a6-aded-f93aafd93511', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ae08f5-256c-4f4f-a790-13165e287192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ae08f5-256c-4f4f-a790-13165e287192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b94275-2576-4622-92fa-2b1152c08098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:06 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Volume 24b5cefb-0c36-49a6-aded-f93aafd93511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b5cefb-0c36-49a6-aded-f93aafd93511', 'volume_size': 1} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1701837006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b5cefb-0c36-49a6-aded-f93aafd93511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba2cfac6310452caf01fbefce96e7fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:25:06Z,use_quota=True,user_id='d707eba2882445eeb77b70a8737543be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Creating volume 24b5cefb-0c36-49a6-aded-f93aafd93511 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:25:06 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:25:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-24b5cefb-0c36-49a6-aded-f93aafd93511 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:06 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-24b5cefb-0c36-49a6-aded-f93aafd93511 1073741824 Jul 06 12:25:06 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:07 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-24b5cefb-0c36-49a6-aded-f93aafd93511 1073741824" returned: 0 in 1.012s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-24b5cefb-0c36-49a6-aded-f93aafd93511 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:07 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-24b5cefb-0c36-49a6-aded-f93aafd93511 Jul 06 12:25:07 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:07 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-f977f3bb-79f8-4d84-a921-494b47fd3c82 req-e1a7034b-d9e0-405f-8da0-954befe3e537 tempest-TestInstancesWithCinderVolumes-1907871535 None] Terminate volume connection completed successfully. Jul 06 12:25:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-f977f3bb-79f8-4d84-a921-494b47fd3c82 req-e1a7034b-d9e0-405f-8da0-954befe3e537 tempest-TestInstancesWithCinderVolumes-1907871535 None] Deleting attachment 61ea6437-bf44-4512-baf0-30559f725c7c. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:25:08 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-24b5cefb-0c36-49a6-aded-f93aafd93511" returned: 0 in 0.678s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:25:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b94275-2576-4622-92fa-2b1152c08098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b5cefb-0c36-49a6-aded-f93aafd93511', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2de149-a9d5-4201-a765-0e3cf9758858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:08 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Volume volume-24b5cefb-0c36-49a6-aded-f93aafd93511 (24b5cefb-0c36-49a6-aded-f93aafd93511): created successfully Jul 06 12:25:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2de149-a9d5-4201-a765-0e3cf9758858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Flow 'volume_create_manager' (ff6716de-7cd0-41d3-9fc9-acab8f56c93c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:25:08 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-9fed92ca-226e-4ef2-8318-42d998876404 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Created volume successfully. Jul 06 12:25:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "cinder-5629d6a3-85fb-4c7c-adfd-279f9daa4508-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "cinder-5629d6a3-85fb-4c7c-adfd-279f9daa4508-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "cinder-quobyte-5629d6a3-85fb-4c7c-adfd-279f9daa4508" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "cinder-quobyte-5629d6a3-85fb-4c7c-adfd-279f9daa4508" acquired by "delete_volume" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:11 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d870d89f-3275-4caf-b381-67d1efd979b7]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:11 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 Jul 06 12:25:11 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-b930b2f1-7bd1-4ad7-a357-647405989567 req-7fc87574-6bd0-4845-8c40-4d0dc8e80290 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-b930b2f1-7bd1-4ad7-a357-647405989567 req-7fc87574-6bd0-4845-8c40-4d0dc8e80290 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:11 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3aa598-715e-4300-bcb6-23f9747bd52c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-b930b2f1-7bd1-4ad7-a357-647405989567 req-7fc87574-6bd0-4845-8c40-4d0dc8e80290 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-24b5cefb-0c36-49a6-aded-f93aafd93511 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:11 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-24b5cefb-0c36-49a6-aded-f93aafd93511 Jul 06 12:25:11 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:12 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508" returned: 0 in 0.902s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:12 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 Jul 06 12:25:12 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:12 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-b930b2f1-7bd1-4ad7-a357-647405989567 req-7fc87574-6bd0-4845-8c40-4d0dc8e80290 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-24b5cefb-0c36-49a6-aded-f93aafd93511" returned: 0 in 0.904s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-b930b2f1-7bd1-4ad7-a357-647405989567 req-7fc87574-6bd0-4845-8c40-4d0dc8e80290 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.925s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-b930b2f1-7bd1-4ad7-a357-647405989567 req-7fc87574-6bd0-4845-8c40-4d0dc8e80290 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-24b5cefb-0c36-49a6-aded-f93aafd93511', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '822ee839-2ba0-4ee8-8f50-5cbb16948d75', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:25:12 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-b930b2f1-7bd1-4ad7-a357-647405989567 req-7fc87574-6bd0-4845-8c40-4d0dc8e80290 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] attachment_update completed successfully. Jul 06 12:25:12 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508" returned: 1 in 0.800s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:25:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:12 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508 Jul 06 12:25:12 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:13 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5629d6a3-85fb-4c7c-adfd-279f9daa4508" returned: 0 in 0.705s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "cinder-quobyte-5629d6a3-85fb-4c7c-adfd-279f9daa4508" released by "delete_volume" :: held 2.475s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:13 devstack cinder-volume[86761]: WARNING cinder.quota [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1297106158-1406914879 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1297106158-1406914879, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:25:13 devstack cinder-volume[86761]: WARNING cinder.quota [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1297106158-1406914879 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1297106158-1406914879, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:25:13 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Created reservations ['19e3928b-0897-4ed1-9b91-53e5a315413d', 'd06f17e6-22d8-4735-bce7-6d59e5287edf', '4e8e88ac-513d-43da-ab65-02e4f856fbc2', '901d0620-05fb-4b44-a54d-68145a6f87a9'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:13 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:25:13 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:14 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.712s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:14 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:25:14 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Deleted volume successfully. Jul 06 12:25:14 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-706d664b-5de9-4d83-869f-efe31d429c14 tempest-TestInstancesWithCinderVolumes-1907871535 None] Lock "cinder-5629d6a3-85fb-4c7c-adfd-279f9daa4508-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:20 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-a87b72b1-13b8-4e90-a8e9-19d7caa8e2c6 req-2f59017b-af96-479a-aadf-1a0b438709e5 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Terminate volume connection completed successfully. Jul 06 12:25:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-a87b72b1-13b8-4e90-a8e9-19d7caa8e2c6 req-2f59017b-af96-479a-aadf-1a0b438709e5 tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Deleting attachment 822ee839-2ba0-4ee8-8f50-5cbb16948d75. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:25:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Acquiring lock "cinder-24b5cefb-0c36-49a6-aded-f93aafd93511-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Lock "cinder-24b5cefb-0c36-49a6-aded-f93aafd93511-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Acquiring lock "cinder-quobyte-24b5cefb-0c36-49a6-aded-f93aafd93511" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Lock "cinder-quobyte-24b5cefb-0c36-49a6-aded-f93aafd93511" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:22 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[858493de-5706-4a45-a391-5cc97ba32409]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-24b5cefb-0c36-49a6-aded-f93aafd93511 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:22 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-24b5cefb-0c36-49a6-aded-f93aafd93511 Jul 06 12:25:22 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:23 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-24b5cefb-0c36-49a6-aded-f93aafd93511" returned: 0 in 0.906s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-24b5cefb-0c36-49a6-aded-f93aafd93511 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:23 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-24b5cefb-0c36-49a6-aded-f93aafd93511 Jul 06 12:25:23 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:24 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-24b5cefb-0c36-49a6-aded-f93aafd93511" returned: 0 in 0.754s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Lock "cinder-quobyte-24b5cefb-0c36-49a6-aded-f93aafd93511" released by "delete_volume" :: held 1.708s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:24 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Created reservations ['ee771af7-8068-43a0-9c24-a370be82ea14', 'ec6bb885-5adc-408f-ace9-5305b6306cf5', '0b47ab5d-ac93-4cdd-bd9a-9819fc668fdd', '49630482-b84e-4781-bbcc-69474304845a'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:24 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:25:24 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:25 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.821s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:25 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:25:25 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Deleted volume successfully. Jul 06 12:25:25 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-79e5a851-786d-4819-88e0-f96dcc9f8adf tempest-TestServerVolumeAttachScenarioOldVersion-334023744 None] Lock "cinder-24b5cefb-0c36-49a6-aded-f93aafd93511-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:35 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=33,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:25:36 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=31,cinder:INSERT=9,cinder:UPDATE=43,cinder:DELETE=3 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:25:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:25:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:52 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:25:52 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:53 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.826s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:25:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:25:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:25:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:26:15 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:26:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Flow 'volume_create_manager' (f2b2b5d7-d958-43a3-8c98-30520ea3b574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0e1524-53a5-451d-b902-1b2d82c3e292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0e1524-53a5-451d-b902-1b2d82c3e292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1635002710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efb1a47-d582-4ba4-a0bc-6c46d7603dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3273bb89f57f4ab6be9ad0fc1b1f4cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:16Z,use_quota=True,user_id='73848f3064044f38888389b532cf6330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c76aa0-8483-4bac-86c1-b0105770a023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c76aa0-8483-4bac-86c1-b0105770a023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33caa206-414f-436e-bc52-10696137ced2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33caa206-414f-436e-bc52-10696137ced2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0efb1a47-d582-4ba4-a0bc-6c46d7603dcb', 'volume_name': 'volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b84ff1a-8c72-4b83-ae87-55ccbf5538ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b84ff1a-8c72-4b83-ae87-55ccbf5538ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c1349e-d5c8-40b8-b15f-b0adafb05321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:16 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Volume 0efb1a47-d582-4ba4-a0bc-6c46d7603dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb', 'volume_size': 1} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1635002710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efb1a47-d582-4ba4-a0bc-6c46d7603dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3273bb89f57f4ab6be9ad0fc1b1f4cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:16Z,use_quota=True,user_id='73848f3064044f38888389b532cf6330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Creating volume 0efb1a47-d582-4ba4-a0bc-6c46d7603dcb {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:26:16 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:26:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:16 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb 1073741824 Jul 06 12:26:16 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:17 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb 1073741824" returned: 0 in 1.105s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:17 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb Jul 06 12:26:17 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:18 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb" returned: 0 in 0.879s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c1349e-d5c8-40b8-b15f-b0adafb05321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6b0758-5546-4c5a-88de-7a62959f54a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:18 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Volume volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb (0efb1a47-d582-4ba4-a0bc-6c46d7603dcb): created successfully Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6b0758-5546-4c5a-88de-7a62959f54a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Flow 'volume_create_manager' (f2b2b5d7-d958-43a3-8c98-30520ea3b574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:18 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ed3e5da4-9a8c-4587-b16e-7313fddd22ec tempest-TestMinimumBasicScenario-1318327201 None] Created volume successfully. Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Flow 'volume_create_manager' (9e4e6200-835e-4a35-9011-ca38b8f778f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80476ab9-3946-4bb1-b505-ad558278040d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80476ab9-3946-4bb1-b505-ad558278040d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-264576346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a28a0ad-8563-4e00-8638-7c583080c244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='982f1fc5b8804834b0b7d51a20c20f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:18Z,use_quota=True,user_id='bc053fb5a31a43e2a71eb65184b50cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ae1f87-6177-426f-aaef-88d1cebe51e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ae1f87-6177-426f-aaef-88d1cebe51e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccd9cd1-669f-47fe-bdff-47a40a083780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccd9cd1-669f-47fe-bdff-47a40a083780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a28a0ad-8563-4e00-8638-7c583080c244', 'volume_name': 'volume-3a28a0ad-8563-4e00-8638-7c583080c244', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c52407d-69c3-4859-a87a-0af15ceff744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c52407d-69c3-4859-a87a-0af15ceff744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ec840f-a684-45f1-a03d-cf91b698a951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:18 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Volume 3a28a0ad-8563-4e00-8638-7c583080c244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a28a0ad-8563-4e00-8638-7c583080c244', 'volume_size': 1} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-264576346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a28a0ad-8563-4e00-8638-7c583080c244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='982f1fc5b8804834b0b7d51a20c20f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:18Z,use_quota=True,user_id='bc053fb5a31a43e2a71eb65184b50cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Creating volume 3a28a0ad-8563-4e00-8638-7c583080c244 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:26:18 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:26:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:18 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 1073741824 Jul 06 12:26:18 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:19 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 1073741824" returned: 0 in 1.305s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:20 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 Jul 06 12:26:20 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:20 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244" returned: 0 in 0.941s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] <== create_volume: return (2305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:26:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.308s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ec840f-a684-45f1-a03d-cf91b698a951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a28a0ad-8563-4e00-8638-7c583080c244', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f067b315-31a5-468b-a212-c35b7ce58e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:20 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Volume volume-3a28a0ad-8563-4e00-8638-7c583080c244 (3a28a0ad-8563-4e00-8638-7c583080c244): created successfully Jul 06 12:26:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f067b315-31a5-468b-a212-c35b7ce58e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Flow 'volume_create_manager' (9e4e6200-835e-4a35-9011-ca38b8f778f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:21 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b9fd82ea-586d-4db4-8d7d-5bde31141132 tempest-TestStampPattern-1751096420 None] Created volume successfully. Jul 06 12:26:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-20de9a32-d2ec-48c6-a7ed-6b80fa7e9350 req-bd314446-b310-4745-868a-1cae68eb8435 tempest-TestMinimumBasicScenario-1318327201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-20de9a32-d2ec-48c6-a7ed-6b80fa7e9350 req-bd314446-b310-4745-868a-1cae68eb8435 tempest-TestMinimumBasicScenario-1318327201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:22 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0644a132-c538-4964-b26f-e621b9820767]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-20de9a32-d2ec-48c6-a7ed-6b80fa7e9350 req-bd314446-b310-4745-868a-1cae68eb8435 tempest-TestMinimumBasicScenario-1318327201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:22 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb Jul 06 12:26:22 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:23 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-20de9a32-d2ec-48c6-a7ed-6b80fa7e9350 req-bd314446-b310-4745-868a-1cae68eb8435 tempest-TestMinimumBasicScenario-1318327201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb" returned: 0 in 0.934s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-20de9a32-d2ec-48c6-a7ed-6b80fa7e9350 req-bd314446-b310-4745-868a-1cae68eb8435 tempest-TestMinimumBasicScenario-1318327201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.957s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-20de9a32-d2ec-48c6-a7ed-6b80fa7e9350 req-bd314446-b310-4745-868a-1cae68eb8435 tempest-TestMinimumBasicScenario-1318327201 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd21c893-1a5d-4e59-a05b-44353ea4a857', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:26:23 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-20de9a32-d2ec-48c6-a7ed-6b80fa7e9350 req-bd314446-b310-4745-868a-1cae68eb8435 tempest-TestMinimumBasicScenario-1318327201 None] attachment_update completed successfully. Jul 06 12:26:33 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:26:33 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=7,cinder:SELECT=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:26:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:26:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:52 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:26:52 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:53 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.750s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:26:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:26:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:26:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:27:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-67276ccb-cf9c-4e7d-ae6a-0375998f5d0b req-bb5e19da-cfec-419d-b67d-c227d4e60b37 tempest-TestStampPattern-1751096420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-67276ccb-cf9c-4e7d-ae6a-0375998f5d0b req-bb5e19da-cfec-419d-b67d-c227d4e60b37 tempest-TestStampPattern-1751096420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:03 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baa5799-2d3b-4d2d-8e7a-1987985109f7]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-67276ccb-cf9c-4e7d-ae6a-0375998f5d0b req-bb5e19da-cfec-419d-b67d-c227d4e60b37 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:03 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 Jul 06 12:27:03 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:03 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-67276ccb-cf9c-4e7d-ae6a-0375998f5d0b req-bb5e19da-cfec-419d-b67d-c227d4e60b37 tempest-TestStampPattern-1751096420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244" returned: 0 in 0.851s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-67276ccb-cf9c-4e7d-ae6a-0375998f5d0b req-bb5e19da-cfec-419d-b67d-c227d4e60b37 tempest-TestStampPattern-1751096420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.881s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-67276ccb-cf9c-4e7d-ae6a-0375998f5d0b req-bb5e19da-cfec-419d-b67d-c227d4e60b37 tempest-TestStampPattern-1751096420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-3a28a0ad-8563-4e00-8638-7c583080c244', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c10aaf4-b8a4-42d7-bc02-fa911c1c6d97', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:27:03 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-67276ccb-cf9c-4e7d-ae6a-0375998f5d0b req-bb5e19da-cfec-419d-b67d-c227d4e60b37 tempest-TestStampPattern-1751096420 None] attachment_update completed successfully. Jul 06 12:27:12 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-985ac406-f817-4c60-9c91-23abc92b03fe req-e12427f4-5d85-4cf5-93ee-b175fb521f90 tempest-TestStampPattern-1751096420 None] Terminate volume connection completed successfully. Jul 06 12:27:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-985ac406-f817-4c60-9c91-23abc92b03fe req-e12427f4-5d85-4cf5-93ee-b175fb521f90 tempest-TestStampPattern-1751096420 None] Deleting attachment 3c10aaf4-b8a4-42d7-bc02-fa911c1c6d97. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:27:13 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=8 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:27:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] Creating offline snapshot 0b608b6b-9928-4813-8f60-9793954abf35 of volume 3a28a0ad-8563-4e00-8638-7c583080c244 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:27:14 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47d229f-8534-4173-b7a4-d8489a55f73a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:14 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 Jul 06 12:27:14 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:15 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244" returned: 0 in 0.842s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:15 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 1G Jul 06 12:27:15 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:16 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-5667c4cc-d04f-4d62-829a-c86e7c759b7d req-17ea32cc-f7be-49f2-99fc-20555b0e7f44 tempest-TestMinimumBasicScenario-1318327201 None] Terminate volume connection completed successfully. Jul 06 12:27:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-5667c4cc-d04f-4d62-829a-c86e7c759b7d req-17ea32cc-f7be-49f2-99fc-20555b0e7f44 tempest-TestMinimumBasicScenario-1318327201 None] Deleting attachment dd21c893-1a5d-4e59-a05b-44353ea4a857. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:27:16 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 1G" returned: 0 in 0.939s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a28a0ad-8563-4e00-8638-7c583080c244 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:16 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a28a0ad-8563-4e00-8638-7c583080c244 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 Jul 06 12:27:16 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:17 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a28a0ad-8563-4e00-8638-7c583080c244 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35" returned: 0 in 0.745s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:17 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 is being set with open permissions: ugo+rw Jul 06 12:27:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:17 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 Jul 06 12:27:17 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:18 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35" returned: 0 in 0.671s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:18 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.info Jul 06 12:27:18 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Acquiring lock "cinder-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Lock "cinder-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Acquiring lock "cinder-quobyte-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Lock "cinder-quobyte-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:18 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e7af94-e1c8-4a56-8174-8ecf4dbf4cb1]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:18 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb Jul 06 12:27:18 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:18 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.info" returned: 0 in 0.669s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:18 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.info is being set with open permissions: ugo+rw Jul 06 12:27:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:18 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.info Jul 06 12:27:18 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:19 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb" returned: 0 in 0.802s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:19 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb Jul 06 12:27:19 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:19 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.info" returned: 0 in 0.655s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.664s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:19 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-de8655bc-316f-48b6-abca-2ee513298ea9 tempest-TestStampPattern-1751096420 None] Create snapshot completed successfully Jul 06 12:27:20 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb" returned: 0 in 0.781s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Lock "cinder-quobyte-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb" released by "delete_volume" :: held 1.637s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:20 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Created reservations ['4b374d0d-8e69-406b-943f-3bc9c5d1e79b', '5bb9eab8-910b-4c99-96aa-df9cfd460202', 'cd62c793-4c25-4b0f-a357-33e311e65aba', 'c9b8e730-a069-4c93-819a-b4865f7c34a4'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:27:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:20 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:27:20 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:21 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.950s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:21 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:27:21 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Deleted volume successfully. Jul 06 12:27:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9c9916d6-1de1-4075-9aca-57983a6a7891 tempest-TestMinimumBasicScenario-1318327201 None] Lock "cinder-0efb1a47-d582-4ba4-a0bc-6c46d7603dcb-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Flow 'volume_create_manager' (e764f1ae-6f36-455a-8c53-4a3efe0159e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e4d954-96e3-4ff5-8cb0-4cb761d44bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e4d954-96e3-4ff5-8cb0-4cb761d44bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2095638516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49802d2-1805-4089-9d3a-f24cc37eb80b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='982f1fc5b8804834b0b7d51a20c20f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0b608b6b-9928-4813-8f60-9793954abf35,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:27:30Z,use_quota=True,user_id='bc053fb5a31a43e2a71eb65184b50cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c55e3b-8a4e-498f-80d4-e78a73c97352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c55e3b-8a4e-498f-80d4-e78a73c97352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c97e88-dd2b-469e-9a93-e91dfccc309f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c97e88-dd2b-469e-9a93-e91dfccc309f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e49802d2-1805-4089-9d3a-f24cc37eb80b', 'volume_name': 'volume-e49802d2-1805-4089-9d3a-f24cc37eb80b', 'volume_size': 1, 'snapshot_id': '0b608b6b-9928-4813-8f60-9793954abf35'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940d4a8b-a28d-4966-81e4-baeb8736dc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940d4a8b-a28d-4966-81e4-baeb8736dc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bfb7894-ed30-4aea-9f4d-d6869d38dbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:30 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Volume e49802d2-1805-4089-9d3a-f24cc37eb80b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e49802d2-1805-4089-9d3a-f24cc37eb80b', 'volume_size': 1, 'snapshot_id': '0b608b6b-9928-4813-8f60-9793954abf35'} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Acquiring lock "cinder-quobyte-0b608b6b-9928-4813-8f60-9793954abf35-e49802d2-1805-4089-9d3a-f24cc37eb80b" by "_create_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Lock "cinder-quobyte-0b608b6b-9928-4813-8f60-9793954abf35-e49802d2-1805-4089-9d3a-f24cc37eb80b" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Creating volume e49802d2-1805-4089-9d3a-f24cc37eb80b from snapshot 0b608b6b-9928-4813-8f60-9793954abf35 {{(pid=86761) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Acquiring lock "cinder-quobyte-e49802d2-1805-4089-9d3a-f24cc37eb80b" by "_copy_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Lock "cinder-quobyte-e49802d2-1805-4089-9d3a-f24cc37eb80b" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] snapshot: 0b608b6b-9928-4813-8f60-9793954abf35, volume: e49802d2-1805-4089-9d3a-f24cc37eb80b, {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50d3725-339b-41d0-a351-ba184fc3a78a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:30 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 Jul 06 12:27:30 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:31 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35" returned: 0 in 0.944s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a28a0ad-8563-4e00-8638-7c583080c244(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:27:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Creating direct copy from snapshot {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:27:31 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2a9dcf-131c-4d9a-b8c4-da41ac3daaa1]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:32 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 Jul 06 12:27:32 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:32 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244" returned: 0 in 1.145s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:32 devstack cinder-volume[86761]: DEBUG cinder.utils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Path /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b not found in is_blk_device check {{(pid=86761) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:27:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:33 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b Jul 06 12:27:33 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b" returned: 0 in 6.830s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:39 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[634f0cbf-d7a8-4ea6-aaae-982f4ccb3d28]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:40 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 Jul 06 12:27:40 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:40 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=14,cinder:UPDATE=13,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:27:40 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=11,cinder:SELECT=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:27:41 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244" returned: 0 in 1.433s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:41 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244, size 1024.00 MB, duration 6.83 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:27:41 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Converted 1024.00 MB image at 149.88 MB/s Jul 06 12:27:41 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b is being set with open permissions: ugo+rw Jul 06 12:27:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:41 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b Jul 06 12:27:41 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:42 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b" returned: 0 in 1.071s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Lock "cinder-quobyte-e49802d2-1805-4089-9d3a-f24cc37eb80b" released by "_copy_volume_from_snapshot" :: held 11.573s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Lock "cinder-quobyte-0b608b6b-9928-4813-8f60-9793954abf35-e49802d2-1805-4089-9d3a-f24cc37eb80b" released by "_create_volume_from_snapshot" :: held 11.621s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.640s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bfb7894-ed30-4aea-9f4d-d6869d38dbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e49802d2-1805-4089-9d3a-f24cc37eb80b', 'volume_size': 1, 'snapshot_id': '0b608b6b-9928-4813-8f60-9793954abf35'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6a9a90-9e54-4bd2-ab73-b82825c300b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:42 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Volume volume-e49802d2-1805-4089-9d3a-f24cc37eb80b (e49802d2-1805-4089-9d3a-f24cc37eb80b): created successfully Jul 06 12:27:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6a9a90-9e54-4bd2-ab73-b82825c300b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Flow 'volume_create_manager' (e764f1ae-6f36-455a-8c53-4a3efe0159e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:27:42 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f16597da-b601-4ece-ae56-77652501157f tempest-TestStampPattern-1751096420 None] Created volume successfully. Jul 06 12:27:52 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=2 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:27:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:27:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:52 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:27:52 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:27:52 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:53 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.830s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:27:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:27:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:27:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Flow 'volume_create_manager' (fd372cb0-754c-48ff-aa15-1b25a088c7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2b9dfa-6656-4434-9c14-534543f9906a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2b9dfa-6656-4434-9c14-534543f9906a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2144873955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f917627e-0366-47b8-bc61-e305a619bbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb29323ef5c4e84b3b28c27295bc180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:16Z,use_quota=True,user_id='215b44e7d152425eb472fb7c92d13f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b5c33e-1524-4b5f-8a0a-8fb447a1b97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b5c33e-1524-4b5f-8a0a-8fb447a1b97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d49d7f-3830-4a52-9aa9-99e3422cdc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d49d7f-3830-4a52-9aa9-99e3422cdc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f917627e-0366-47b8-bc61-e305a619bbff', 'volume_name': 'volume-f917627e-0366-47b8-bc61-e305a619bbff', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d52ae7-966d-468e-b7b5-55721f01ed02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d52ae7-966d-468e-b7b5-55721f01ed02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e07328b-63f9-4e7b-add3-59b9ddbd1e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:16 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Volume f917627e-0366-47b8-bc61-e305a619bbff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f917627e-0366-47b8-bc61-e305a619bbff', 'volume_size': 1} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2144873955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f917627e-0366-47b8-bc61-e305a619bbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb29323ef5c4e84b3b28c27295bc180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:16Z,use_quota=True,user_id='215b44e7d152425eb472fb7c92d13f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Creating volume f917627e-0366-47b8-bc61-e305a619bbff {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:28:16 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f917627e-0366-47b8-bc61-e305a619bbff 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:16 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f917627e-0366-47b8-bc61-e305a619bbff 1073741824 Jul 06 12:28:16 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Flow 'volume_create_manager' (6d748b9d-00ff-4774-b339-2b2b4b6a5364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca65cbc-d45c-4bb2-a0e3-004e07c37f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca65cbc-d45c-4bb2-a0e3-004e07c37f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1781365452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681a9533-b22a-49e0-9886-29499f2b332b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb29323ef5c4e84b3b28c27295bc180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:17Z,use_quota=True,user_id='215b44e7d152425eb472fb7c92d13f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb820c7c-a287-4578-811f-96a5b6646c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb820c7c-a287-4578-811f-96a5b6646c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b66180-058c-402e-91ce-3c3b2752a9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b66180-058c-402e-91ce-3c3b2752a9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '681a9533-b22a-49e0-9886-29499f2b332b', 'volume_name': 'volume-681a9533-b22a-49e0-9886-29499f2b332b', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad6069f-5d11-4d46-b5f8-2ae431bb662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad6069f-5d11-4d46-b5f8-2ae431bb662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df141dfb-7543-494d-8826-ecb4088932fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:16 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Volume 681a9533-b22a-49e0-9886-29499f2b332b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-681a9533-b22a-49e0-9886-29499f2b332b', 'volume_size': 1} Jul 06 12:28:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:17 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f917627e-0366-47b8-bc61-e305a619bbff 1073741824" returned: 0 in 1.125s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f917627e-0366-47b8-bc61-e305a619bbff {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:17 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f917627e-0366-47b8-bc61-e305a619bbff Jul 06 12:28:17 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:18 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f917627e-0366-47b8-bc61-e305a619bbff" returned: 0 in 0.742s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.511s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1781365452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681a9533-b22a-49e0-9886-29499f2b332b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb29323ef5c4e84b3b28c27295bc180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:17Z,use_quota=True,user_id='215b44e7d152425eb472fb7c92d13f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Creating volume 681a9533-b22a-49e0-9886-29499f2b332b {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:28:18 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-681a9533-b22a-49e0-9886-29499f2b332b 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:18 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-681a9533-b22a-49e0-9886-29499f2b332b 1073741824 Jul 06 12:28:18 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e07328b-63f9-4e7b-add3-59b9ddbd1e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f917627e-0366-47b8-bc61-e305a619bbff', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e8251b-6381-43c3-9073-7e9876d87141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:18 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Volume volume-f917627e-0366-47b8-bc61-e305a619bbff (f917627e-0366-47b8-bc61-e305a619bbff): created successfully Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e8251b-6381-43c3-9073-7e9876d87141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Flow 'volume_create_manager' (fd372cb0-754c-48ff-aa15-1b25a088c7b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:18 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7088f5fb-b6c4-4709-93b1-840c25a75c3a tempest-TestServerVolumeAttachmentScenario-1153461795 None] Created volume successfully. Jul 06 12:28:19 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-681a9533-b22a-49e0-9886-29499f2b332b 1073741824" returned: 0 in 1.075s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-681a9533-b22a-49e0-9886-29499f2b332b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:19 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-681a9533-b22a-49e0-9886-29499f2b332b Jul 06 12:28:19 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:20 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-681a9533-b22a-49e0-9886-29499f2b332b" returned: 0 in 0.828s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:28:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df141dfb-7543-494d-8826-ecb4088932fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-681a9533-b22a-49e0-9886-29499f2b332b', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cf83f9-07f1-442f-b17a-eae3fab6bf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:20 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Volume volume-681a9533-b22a-49e0-9886-29499f2b332b (681a9533-b22a-49e0-9886-29499f2b332b): created successfully Jul 06 12:28:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cf83f9-07f1-442f-b17a-eae3fab6bf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Flow 'volume_create_manager' (6d748b9d-00ff-4774-b339-2b2b4b6a5364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:20 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-8d138f8e-6d43-4623-a204-753320ee5ab1 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Created volume successfully. Jul 06 12:28:30 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:28:30 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=9,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:28:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-96e8eed8-bd92-49ea-bbac-3a48670a7b10 req-fce045dd-be6f-43e8-aadf-e48db4216a2b tempest-TestStampPattern-1751096420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-96e8eed8-bd92-49ea-bbac-3a48670a7b10 req-fce045dd-be6f-43e8-aadf-e48db4216a2b tempest-TestStampPattern-1751096420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:33 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[852152f8-3e52-4187-80a6-0af920b4a073]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-96e8eed8-bd92-49ea-bbac-3a48670a7b10 req-fce045dd-be6f-43e8-aadf-e48db4216a2b tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:33 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b Jul 06 12:28:33 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:34 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-96e8eed8-bd92-49ea-bbac-3a48670a7b10 req-fce045dd-be6f-43e8-aadf-e48db4216a2b tempest-TestStampPattern-1751096420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b" returned: 0 in 0.953s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-96e8eed8-bd92-49ea-bbac-3a48670a7b10 req-fce045dd-be6f-43e8-aadf-e48db4216a2b tempest-TestStampPattern-1751096420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.978s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:34 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-96e8eed8-bd92-49ea-bbac-3a48670a7b10 req-fce045dd-be6f-43e8-aadf-e48db4216a2b tempest-TestStampPattern-1751096420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-e49802d2-1805-4089-9d3a-f24cc37eb80b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ca42861-90f4-45ca-a2c0-e270e0776a51', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:28:34 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-96e8eed8-bd92-49ea-bbac-3a48670a7b10 req-fce045dd-be6f-43e8-aadf-e48db4216a2b tempest-TestStampPattern-1751096420 None] attachment_update completed successfully. Jul 06 12:28:42 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-3ca74f1b-efe7-47e7-8652-dfe655f50c59 req-4067fa00-422a-4f41-9255-ca0c203ab96d tempest-TestStampPattern-1751096420 None] Terminate volume connection completed successfully. Jul 06 12:28:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-3ca74f1b-efe7-47e7-8652-dfe655f50c59 req-4067fa00-422a-4f41-9255-ca0c203ab96d tempest-TestStampPattern-1751096420 None] Deleting attachment 2ca42861-90f4-45ca-a2c0-e270e0776a51. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:28:52 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=6 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:28:52 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:28:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:28:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:52 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:28:52 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Acquiring lock "cinder-e49802d2-1805-4089-9d3a-f24cc37eb80b-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Lock "cinder-e49802d2-1805-4089-9d3a-f24cc37eb80b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Acquiring lock "cinder-quobyte-e49802d2-1805-4089-9d3a-f24cc37eb80b" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Lock "cinder-quobyte-e49802d2-1805-4089-9d3a-f24cc37eb80b" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:53 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[69af68af-9819-4606-9da8-a89febc931f8]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:53 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.913s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:28:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:28:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:28:53 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b Jul 06 12:28:53 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:54 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b" returned: 0 in 0.798s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:54 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b Jul 06 12:28:54 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:54 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e49802d2-1805-4089-9d3a-f24cc37eb80b" returned: 0 in 0.634s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Lock "cinder-quobyte-e49802d2-1805-4089-9d3a-f24cc37eb80b" released by "delete_volume" :: held 1.482s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:54 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Created reservations ['74fbc354-5829-422f-bc34-4c6ac68c091a', 'aa696ab0-2422-46c0-9e67-3e18f5caff5c', '60632df7-3021-4b7b-aa5b-ae76fe84d431', '5433f356-e1d3-4693-a299-b0ad0302295f'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:54 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:28:54 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:55 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.756s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:55 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:55 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Deleted volume successfully. Jul 06 12:28:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0bf15ce3-7932-4518-bd65-c5af01a62ebe tempest-TestStampPattern-1751096420 None] Lock "cinder-e49802d2-1805-4089-9d3a-f24cc37eb80b-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Acquiring lock "cinder-0b608b6b-9928-4813-8f60-9793954abf35-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Lock "cinder-0b608b6b-9928-4813-8f60-9793954abf35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Acquiring lock "cinder-quobyte-3a28a0ad-8563-4e00-8638-7c583080c244" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Lock "cinder-quobyte-3a28a0ad-8563-4e00-8638-7c583080c244" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Acquiring lock "cinder-quobyte-0b608b6b-9928-4813-8f60-9793954abf35" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Lock "cinder-quobyte-0b608b6b-9928-4813-8f60-9793954abf35" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Deleting offline snapshot 0b608b6b-9928-4813-8f60-9793954abf35 of volume 3a28a0ad-8563-4e00-8638-7c583080c244 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:28:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] snapshot_file for this snap is: volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:28:55 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bbe76a-63ee-4785-a52b-f88c1a08c72e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:56 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 Jul 06 12:28:56 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:56 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35" returned: 0 in 0.778s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a28a0ad-8563-4e00-8638-7c583080c244(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:28:56 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f320f6-f505-47a3-bde8-370114911c59]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:56 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 Jul 06 12:28:56 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:57 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244" returned: 0 in 0.841s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:57 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 Jul 06 12:28:57 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:58 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35" returned: 0 in 0.792s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:58 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35 Jul 06 12:28:58 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:59 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244.0b608b6b-9928-4813-8f60-9793954abf35" returned: 0 in 0.750s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Lock "cinder-quobyte-0b608b6b-9928-4813-8f60-9793954abf35" released by "_delete_snapshot" :: held 3.264s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Lock "cinder-quobyte-3a28a0ad-8563-4e00-8638-7c583080c244" released by "delete_snapshot" :: held 3.289s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:59 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Created reservations ['fb5b51cb-6f9d-4db5-bc4b-987d37e4f05b', '01af5c98-b7ee-4daa-bacc-eb4c1d76dea3', '1d73f794-0438-4659-8e38-b013337444e6', '6bbefe93-a94f-4544-9ce1-4e85500d7564'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:59 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Delete snapshot completed successfully. Jul 06 12:28:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6b9628a9-cbcc-4c89-a455-7ad0a12e1ea2 tempest-TestStampPattern-1751096420 None] Lock "cinder-0b608b6b-9928-4813-8f60-9793954abf35-delete_snapshot" released by "delete_snapshot" :: held 3.452s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-eaee7653-34d5-4149-9657-b1a39fc02f84 req-6023b6b1-f296-48af-b9e6-ace88cdb8af3 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-eaee7653-34d5-4149-9657-b1a39fc02f84 req-6023b6b1-f296-48af-b9e6-ace88cdb8af3 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:00 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c436af-4504-40c1-bb05-0ef25ffdece4]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-eaee7653-34d5-4149-9657-b1a39fc02f84 req-6023b6b1-f296-48af-b9e6-ace88cdb8af3 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f917627e-0366-47b8-bc61-e305a619bbff {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:00 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f917627e-0366-47b8-bc61-e305a619bbff Jul 06 12:29:00 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:01 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-eaee7653-34d5-4149-9657-b1a39fc02f84 req-6023b6b1-f296-48af-b9e6-ace88cdb8af3 tempest-TestServerVolumeAttachmentScenario-1153461795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f917627e-0366-47b8-bc61-e305a619bbff" returned: 0 in 1.004s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-eaee7653-34d5-4149-9657-b1a39fc02f84 req-6023b6b1-f296-48af-b9e6-ace88cdb8af3 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.024s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-eaee7653-34d5-4149-9657-b1a39fc02f84 req-6023b6b1-f296-48af-b9e6-ace88cdb8af3 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-f917627e-0366-47b8-bc61-e305a619bbff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '484e615c-6601-42c7-a176-5c4af85aa498', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:29:01 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-eaee7653-34d5-4149-9657-b1a39fc02f84 req-6023b6b1-f296-48af-b9e6-ace88cdb8af3 tempest-TestServerVolumeAttachmentScenario-1153461795 None] attachment_update completed successfully. Jul 06 12:29:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Acquiring lock "cinder-3a28a0ad-8563-4e00-8638-7c583080c244-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Lock "cinder-3a28a0ad-8563-4e00-8638-7c583080c244-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Acquiring lock "cinder-quobyte-3a28a0ad-8563-4e00-8638-7c583080c244" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Lock "cinder-quobyte-3a28a0ad-8563-4e00-8638-7c583080c244" acquired by "delete_volume" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:08 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3314daa-71c6-4462-b204-d4540ee94d2a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:08 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 Jul 06 12:29:08 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:09 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244" returned: 0 in 0.811s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:09 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244 Jul 06 12:29:09 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:10 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-3a28a0ad-8563-4e00-8638-7c583080c244" returned: 0 in 0.670s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Lock "cinder-quobyte-3a28a0ad-8563-4e00-8638-7c583080c244" released by "delete_volume" :: held 1.541s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:10 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Created reservations ['7349e2eb-fd11-49af-a8d7-de9e5b8b4f61', '3b08dffd-3024-481a-964a-e7e60b56a831', '1a9a4a85-36bf-4c2b-b23b-0205cda3427d', 'd811a557-b86a-444a-8162-b5c0e8679f04'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:10 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:29:10 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:11 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.738s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:11 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:11 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Deleted volume successfully. Jul 06 12:29:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-cfdefb6a-d1b5-4286-ab8b-e64172e45c52 tempest-TestStampPattern-1751096420 None] Lock "cinder-3a28a0ad-8563-4e00-8638-7c583080c244-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-89345a28-7b66-4bfa-b65a-7066a7b57c91 req-6cfc1c82-d9d2-4e90-be39-a185b83d2ca4 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-89345a28-7b66-4bfa-b65a-7066a7b57c91 req-6cfc1c82-d9d2-4e90-be39-a185b83d2ca4 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:11 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df7f727-2d26-402f-b784-88abd1d8d6e2]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-89345a28-7b66-4bfa-b65a-7066a7b57c91 req-6cfc1c82-d9d2-4e90-be39-a185b83d2ca4 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-681a9533-b22a-49e0-9886-29499f2b332b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:11 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-681a9533-b22a-49e0-9886-29499f2b332b Jul 06 12:29:11 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:12 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-89345a28-7b66-4bfa-b65a-7066a7b57c91 req-6cfc1c82-d9d2-4e90-be39-a185b83d2ca4 tempest-TestServerVolumeAttachmentScenario-1153461795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-681a9533-b22a-49e0-9886-29499f2b332b" returned: 0 in 0.911s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-89345a28-7b66-4bfa-b65a-7066a7b57c91 req-6cfc1c82-d9d2-4e90-be39-a185b83d2ca4 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.932s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-89345a28-7b66-4bfa-b65a-7066a7b57c91 req-6cfc1c82-d9d2-4e90-be39-a185b83d2ca4 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-681a9533-b22a-49e0-9886-29499f2b332b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '039e40db-0675-4d13-9087-155285cd5f0a', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:29:12 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-89345a28-7b66-4bfa-b65a-7066a7b57c91 req-6cfc1c82-d9d2-4e90-be39-a185b83d2ca4 tempest-TestServerVolumeAttachmentScenario-1153461795 None] attachment_update completed successfully. Jul 06 12:29:18 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-28da6273-99d2-4f38-8306-a778d07ac76e req-a5cc550b-e9cf-4bf4-a2cb-e70b1ea572c0 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Terminate volume connection completed successfully. Jul 06 12:29:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-28da6273-99d2-4f38-8306-a778d07ac76e req-a5cc550b-e9cf-4bf4-a2cb-e70b1ea572c0 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Deleting attachment 039e40db-0675-4d13-9087-155285cd5f0a. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:29:22 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-31295924-f000-4595-80f3-2d127d029ca3 req-36f90d9a-17bc-4466-b1bf-a1e065f9d078 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Terminate volume connection completed successfully. Jul 06 12:29:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-31295924-f000-4595-80f3-2d127d029ca3 req-36f90d9a-17bc-4466-b1bf-a1e065f9d078 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Deleting attachment 484e615c-6601-42c7-a176-5c4af85aa498. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:29:26 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Flow 'volume_create_manager' (cd1a7d25-8cd4-4db4-889d-679b46a869fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cac4ed5-7e6d-48c3-8b5e-05ac284853da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cac4ed5-7e6d-48c3-8b5e-05ac284853da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e28e278-1092-46c9-b2d8-ed8c6f014bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79293d247ed4105bdf0ef562b895251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:27Z,use_quota=True,user_id='85047e084697472cb71a82690bf614ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdc7b33b-4eec-4882-a9df-574149da831f),volume_type_id=cdc7b33b-4eec-4882-a9df-574149da831f)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167cb456-dc23-4a0f-8eb5-e66f301526c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167cb456-dc23-4a0f-8eb5-e66f301526c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b53d88-db61-4db2-9f23-580f77d8a01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:27 devstack cinder-volume[86761]: DEBUG cinder.image.glance [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Creating Keystone auth plugin from conf {{(pid=86761) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:29:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b53d88-db61-4db2-9f23-580f77d8a01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e28e278-1092-46c9-b2d8-ed8c6f014bd1', 'volume_name': 'volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1', 'volume_size': 1, 'image_id': '6b0424f5-76b0-438f-b426-b2ba3988c4f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b0424f5-76b0-438f-b426-b2ba3988c4f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a7af38ade599b559599b4108fe5f0852', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f79293d247ed4105bdf0ef562b895251', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9cdbd8820b9d59bad44d5390f3be72e61c44b6b6d47d29007952ee7344b5c57d6200c53c265fb212bfb510689d90370a84b1354282461d959adc60a52600143f', 'id': '6b0424f5-76b0-438f-b426-b2ba3988c4f8', 'created_at': datetime.datetime(2026, 7, 6, 10, 29, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 29, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b0424f5-76b0-438f-b426-b2ba3988c4f8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd4d613-abb1-4735-9e23-997749990d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd4d613-abb1-4735-9e23-997749990d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dbd211-c7aa-4d89-9f15-91de5aa4c785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:27 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Volume 9e28e278-1092-46c9-b2d8-ed8c6f014bd1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1', 'volume_size': 1, 'image_id': '6b0424f5-76b0-438f-b426-b2ba3988c4f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b0424f5-76b0-438f-b426-b2ba3988c4f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a7af38ade599b559599b4108fe5f0852', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f79293d247ed4105bdf0ef562b895251', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9cdbd8820b9d59bad44d5390f3be72e61c44b6b6d47d29007952ee7344b5c57d6200c53c265fb212bfb510689d90370a84b1354282461d959adc60a52600143f', 'id': '6b0424f5-76b0-438f-b426-b2ba3988c4f8', 'created_at': datetime.datetime(2026, 7, 6, 10, 29, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 29, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b0424f5-76b0-438f-b426-b2ba3988c4f8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 12:29:27 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Trying to clone 9e28e278-1092-46c9-b2d8-ed8c6f014bd1 from image 6b0424f5-76b0-438f-b426-b2ba3988c4f8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b0424f5-76b0-438f-b426-b2ba3988c4f8', 'metadata': {}}]). {{(pid=86761) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:29:27 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:29:27 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Image download 0.00 MB at 0.00 MB/s Jul 06 12:29:27 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[4485cfcf-39e9-43d2-a495-d3936e6603cc]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:27 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD Jul 06 12:29:27 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:28 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD" returned: 0 in 0.850s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:28 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD Jul 06 12:29:28 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:29 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD" returned: 1 in 0.762s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:29:29 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Temporary image 6b0424f5-76b0-438f-b426-b2ba3988c4f8 is fetched for user 85047e084697472cb71a82690bf614ff. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:29:29 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff79a64-4c43-4747-8f11-dd2d5855dda4]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:29 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD Jul 06 12:29:29 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:30 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD" returned: 0 in 0.803s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:30 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD Jul 06 12:29:30 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:30 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD" returned: 1 in 0.802s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:29:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e28e278-1092-46c9-b2d8-ed8c6f014bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79293d247ed4105bdf0ef562b895251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:27Z,use_quota=True,user_id='85047e084697472cb71a82690bf614ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdc7b33b-4eec-4882-a9df-574149da831f),volume_type_id=cdc7b33b-4eec-4882-a9df-574149da831f)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Creating volume 9e28e278-1092-46c9-b2d8-ed8c6f014bd1 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:30 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:29:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:30 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 1073741824 Jul 06 12:29:30 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:31 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 1073741824" returned: 0 in 0.845s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:31 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 Jul 06 12:29:31 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:32 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1" returned: 0 in 0.853s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:32 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Attempting download of 6b0424f5-76b0-438f-b426-b2ba3988c4f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b0424f5-76b0-438f-b426-b2ba3988c4f8', 'metadata': {}}])) to volume 9e28e278-1092-46c9-b2d8-ed8c6f014bd1. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:29:32 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e477e0e-3174-4986-b0e8-6db60a35db82]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b0424f5-76b0-438f-b426-b2ba3988c4f8_oszqx4ql {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:32 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b0424f5-76b0-438f-b426-b2ba3988c4f8_oszqx4ql Jul 06 12:29:32 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Acquiring lock "cinder-681a9533-b22a-49e0-9886-29499f2b332b-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "cinder-681a9533-b22a-49e0-9886-29499f2b332b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Acquiring lock "cinder-quobyte-681a9533-b22a-49e0-9886-29499f2b332b" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "cinder-quobyte-681a9533-b22a-49e0-9886-29499f2b332b" acquired by "delete_volume" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:33 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c47f7c-051b-4802-9299-1f8a1c178156]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-681a9533-b22a-49e0-9886-29499f2b332b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:33 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-681a9533-b22a-49e0-9886-29499f2b332b Jul 06 12:29:33 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:33 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b0424f5-76b0-438f-b426-b2ba3988c4f8_oszqx4ql" returned: 0 in 0.890s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b0424f5-76b0-438f-b426-b2ba3988c4f8_oszqx4ql {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:33 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b0424f5-76b0-438f-b426-b2ba3988c4f8_oszqx4ql Jul 06 12:29:33 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:34 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-681a9533-b22a-49e0-9886-29499f2b332b" returned: 0 in 0.808s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-681a9533-b22a-49e0-9886-29499f2b332b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:34 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-681a9533-b22a-49e0-9886-29499f2b332b Jul 06 12:29:34 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:34 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b0424f5-76b0-438f-b426-b2ba3988c4f8_oszqx4ql" returned: 1 in 0.774s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b0424f5-76b0-438f-b426-b2ba3988c4f8_oszqx4ql' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:29:34 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bd4934-d48f-403e-af6f-263de37fff3c]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:34 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD Jul 06 12:29:34 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:34 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-681a9533-b22a-49e0-9886-29499f2b332b" returned: 0 in 0.684s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "cinder-quobyte-681a9533-b22a-49e0-9886-29499f2b332b" released by "delete_volume" :: held 1.546s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:34 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Created reservations ['bda0f5ff-e224-4a30-b522-b861144fe936', '6449f18e-44e8-4d0b-bb01-640760866e3a', '6186883d-d3d7-4728-8cd3-d6c6a6bb557a', '5a19384b-8ec6-44e8-84fa-5f8b293e3976'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:35 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:29:35 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:35 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD" returned: 0 in 0.784s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:35 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD Jul 06 12:29:35 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Acquiring lock "cinder-f917627e-0366-47b8-bc61-e305a619bbff-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "cinder-f917627e-0366-47b8-bc61-e305a619bbff-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Acquiring lock "cinder-quobyte-f917627e-0366-47b8-bc61-e305a619bbff" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "cinder-quobyte-f917627e-0366-47b8-bc61-e305a619bbff" acquired by "delete_volume" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[43844906-38a1-4ac8-b02a-e109d0254dd9]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f917627e-0366-47b8-bc61-e305a619bbff {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:35 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.712s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:35 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f917627e-0366-47b8-bc61-e305a619bbff Jul 06 12:29:35 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:35 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Deleted volume successfully. Jul 06 12:29:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-275edefb-cf3d-4a1e-b030-424d923d758c tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "cinder-681a9533-b22a-49e0-9886-29499f2b332b-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:36 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD" returned: 1 in 0.815s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:29:36 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] 6b0424f5-76b0-438f-b426-b2ba3988c4f8 was raw, converting to raw {{(pid=86761) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:29:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:36 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 Jul 06 12:29:36 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:36 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f917627e-0366-47b8-bc61-e305a619bbff" returned: 0 in 0.799s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f917627e-0366-47b8-bc61-e305a619bbff {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:36 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f917627e-0366-47b8-bc61-e305a619bbff Jul 06 12:29:36 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:36 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1" returned: 0 in 0.821s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:36 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b0424f5-76b0-438f-b426-b2ba3988c4f8_bh_1yjj2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:29:36 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 12:29:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:36 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 1G Jul 06 12:29:36 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:37 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f917627e-0366-47b8-bc61-e305a619bbff" returned: 0 in 0.679s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "cinder-quobyte-f917627e-0366-47b8-bc61-e305a619bbff" released by "delete_volume" :: held 1.522s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:37 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Created reservations ['530bca07-6dd4-453e-8574-4d09e7169e75', 'db570126-a7fc-438e-97df-80bc8c5f8c09', '636085ca-e259-4004-a705-aa6a72ad5e26', 'e7747091-5f4b-49a7-a78b-ec0df0c24c25'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:37 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:29:37 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:37 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 1G" returned: 0 in 0.782s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:37 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f413032-b25b-4140-bdf9-b987c2c3cda4]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:37 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 Jul 06 12:29:37 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:38 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.758s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:38 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:38 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Deleted volume successfully. Jul 06 12:29:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-165a89db-6534-4dd3-9309-2cd84c5b7138 tempest-TestServerVolumeAttachmentScenario-1153461795 None] Lock "cinder-f917627e-0366-47b8-bc61-e305a619bbff-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1" returned: 0 in 0.827s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:38 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:38 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 Jul 06 12:29:38 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:39 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1" returned: 1 in 0.878s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Downloaded image 6b0424f5-76b0-438f-b426-b2ba3988c4f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b0424f5-76b0-438f-b426-b2ba3988c4f8', 'metadata': {}}])) to volume 9e28e278-1092-46c9-b2d8-ed8c6f014bd1 successfully. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Temporary image 6b0424f5-76b0-438f-b426-b2ba3988c4f8 for user 85047e084697472cb71a82690bf614ff is deleted. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Marking volume 9e28e278-1092-46c9-b2d8-ed8c6f014bd1 as bootable. {{(pid=86761) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Copying metadata from image 6b0424f5-76b0-438f-b426-b2ba3988c4f8 to 9e28e278-1092-46c9-b2d8-ed8c6f014bd1. {{(pid=86761) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Creating volume glance metadata for volume 9e28e278-1092-46c9-b2d8-ed8c6f014bd1 backed by image 6b0424f5-76b0-438f-b426-b2ba3988c4f8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6b0424f5-76b0-438f-b426-b2ba3988c4f8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a7af38ade599b559599b4108fe5f0852', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86761) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dbd211-c7aa-4d89-9f15-91de5aa4c785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1', 'volume_size': 1, 'image_id': '6b0424f5-76b0-438f-b426-b2ba3988c4f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b0424f5-76b0-438f-b426-b2ba3988c4f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a7af38ade599b559599b4108fe5f0852', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f79293d247ed4105bdf0ef562b895251', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9cdbd8820b9d59bad44d5390f3be72e61c44b6b6d47d29007952ee7344b5c57d6200c53c265fb212bfb510689d90370a84b1354282461d959adc60a52600143f', 'id': '6b0424f5-76b0-438f-b426-b2ba3988c4f8', 'created_at': datetime.datetime(2026, 7, 6, 10, 29, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 29, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b0424f5-76b0-438f-b426-b2ba3988c4f8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9579ca-2289-4e3c-8a7b-af4876aad3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:39 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Volume volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 (9e28e278-1092-46c9-b2d8-ed8c6f014bd1): created successfully Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9579ca-2289-4e3c-8a7b-af4876aad3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Flow 'volume_create_manager' (cd1a7d25-8cd4-4db4-889d-679b46a869fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:39 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ff31d10c-254b-4a6f-aadd-b073d1f97b0f tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Created volume successfully. Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Acquiring lock "cinder-9e28e278-1092-46c9-b2d8-ed8c6f014bd1-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Lock "cinder-9e28e278-1092-46c9-b2d8-ed8c6f014bd1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Acquiring lock "cinder-quobyte-9e28e278-1092-46c9-b2d8-ed8c6f014bd1" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Lock "cinder-quobyte-9e28e278-1092-46c9-b2d8-ed8c6f014bd1" acquired by "delete_volume" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09fa26b-ed03-405e-b9f0-fe1c640333ae]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:40 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 Jul 06 12:29:40 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:40 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1" returned: 0 in 0.879s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:40 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 Jul 06 12:29:40 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:41 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1" returned: 1 in 0.986s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:29:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:41 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1 Jul 06 12:29:41 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:42 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9e28e278-1092-46c9-b2d8-ed8c6f014bd1" returned: 0 in 0.775s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Lock "cinder-quobyte-9e28e278-1092-46c9-b2d8-ed8c6f014bd1" released by "delete_volume" :: held 2.711s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:42 devstack cinder-volume[86761]: WARNING cinder.quota [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:29:42 devstack cinder-volume[86761]: WARNING cinder.quota [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:29:42 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Created reservations ['f1d7754d-1ea1-4597-8b92-69ca36f6e665', '7865aeaa-45e6-4b9e-bb3d-a09257425933', 'd4dea955-c1df-43e0-ba0c-829c591b6681', '89ebc9cb-ed38-42cc-9b65-cd714f4cc3b0'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:42 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:29:42 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:43 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.893s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:43 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:43 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Deleted volume successfully. Jul 06 12:29:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7a851a11-086f-43d7-82cf-4ebdaae8a6dd tempest-VolumeAndVolumeTypeFromImageTest-395357662 None] Lock "cinder-9e28e278-1092-46c9-b2d8-ed8c6f014bd1-delete_volume" released by "delete_volume" :: held 3.900s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Flow 'volume_create_manager' (76212932-655f-4a8f-bc43-d96eb7b0677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d449bc-1fa5-48da-ad64-fae4e66bd104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d449bc-1fa5-48da-ad64-fae4e66bd104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d65896-9725-4858-8863-f511e5ded88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1988b5b1118247fcaaf91076517d2183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:50Z,use_quota=True,user_id='6f41b531eaab44a897f9e58c8121e353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c3ac83-4539-4cde-939d-b8afb8173c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c3ac83-4539-4cde-939d-b8afb8173c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3f3cae-0a83-4c61-950f-9d727cac0eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3f3cae-0a83-4c61-950f-9d727cac0eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d65896-9725-4858-8863-f511e5ded88a', 'volume_name': 'volume-40d65896-9725-4858-8863-f511e5ded88a', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16861f09-b0a5-424f-b1e5-3f5abac81759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16861f09-b0a5-424f-b1e5-3f5abac81759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560f41fa-d686-4598-a488-6cfde9ffa706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:49 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Volume 40d65896-9725-4858-8863-f511e5ded88a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d65896-9725-4858-8863-f511e5ded88a', 'volume_size': 1} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d65896-9725-4858-8863-f511e5ded88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1988b5b1118247fcaaf91076517d2183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:50Z,use_quota=True,user_id='6f41b531eaab44a897f9e58c8121e353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Creating volume 40d65896-9725-4858-8863-f511e5ded88a {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:49 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:29:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40d65896-9725-4858-8863-f511e5ded88a 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:49 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40d65896-9725-4858-8863-f511e5ded88a 1073741824 Jul 06 12:29:49 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:50 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40d65896-9725-4858-8863-f511e5ded88a 1073741824" returned: 0 in 0.982s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40d65896-9725-4858-8863-f511e5ded88a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:50 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40d65896-9725-4858-8863-f511e5ded88a Jul 06 12:29:50 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:51 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40d65896-9725-4858-8863-f511e5ded88a" returned: 0 in 0.752s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:51 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560f41fa-d686-4598-a488-6cfde9ffa706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d65896-9725-4858-8863-f511e5ded88a', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f15c842-301e-4401-9fef-48a959bc5a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:51 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Volume volume-40d65896-9725-4858-8863-f511e5ded88a (40d65896-9725-4858-8863-f511e5ded88a): created successfully Jul 06 12:29:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f15c842-301e-4401-9fef-48a959bc5a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Flow 'volume_create_manager' (76212932-655f-4a8f-bc43-d96eb7b0677d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-490bbafc-cf4c-428e-ba7e-670cd108e942 tempest-CinderUnicodeTest-1560295512 None] Created volume successfully. Jul 06 12:29:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:29:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:29:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=56,cinder:UPDATE=53,cinder:INSERT=18,cinder:DELETE=3 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=53,cinder:INSERT=18,cinder:UPDATE=61,cinder:DELETE=4 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Flow 'volume_create_manager' (fb2fd52d-8745-4b65-895a-753b3526a075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e72ded-f7d2-4bdb-8b10-51d725849540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e72ded-f7d2-4bdb-8b10-51d725849540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1515114151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a434e4a7-8b51-4dc4-a232-d5eed595ad18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1988b5b1118247fcaaf91076517d2183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:53Z,use_quota=True,user_id='6f41b531eaab44a897f9e58c8121e353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d08f0964-6f3e-4746-8bc9-b952df3e18cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d08f0964-6f3e-4746-8bc9-b952df3e18cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5208e587-4289-4c1e-99a1-344d639a7011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5208e587-4289-4c1e-99a1-344d639a7011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a434e4a7-8b51-4dc4-a232-d5eed595ad18', 'volume_name': 'volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b330b26e-b1b0-4106-8099-6184c89c96c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b330b26e-b1b0-4106-8099-6184c89c96c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a37bad-4dd3-4333-a7c8-eb903e60c464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:53 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Volume a434e4a7-8b51-4dc4-a232-d5eed595ad18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18', 'volume_size': 1} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1515114151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a434e4a7-8b51-4dc4-a232-d5eed595ad18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1988b5b1118247fcaaf91076517d2183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:53Z,use_quota=True,user_id='6f41b531eaab44a897f9e58c8121e353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Creating volume a434e4a7-8b51-4dc4-a232-d5eed595ad18 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:53 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:29:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:53 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 1073741824 Jul 06 12:29:53 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:54 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 1073741824" returned: 0 in 1.048s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:54 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 Jul 06 12:29:54 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:55 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18" returned: 0 in 0.803s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a37bad-4dd3-4333-a7c8-eb903e60c464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e047b324-2519-41ef-8951-9512d5c8c50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Volume volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 (a434e4a7-8b51-4dc4-a232-d5eed595ad18): created successfully Jul 06 12:29:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e047b324-2519-41ef-8951-9512d5c8c50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Flow 'volume_create_manager' (fb2fd52d-8745-4b65-895a-753b3526a075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:55 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-e53416b6-74e9-499e-8280-b2fe3575d8b4 tempest-CinderUnicodeTest-1560295512 None] Created volume successfully. Jul 06 12:29:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] Creating offline snapshot d67585db-52ef-49cd-9ffc-f5356fc38f37 of volume a434e4a7-8b51-4dc4-a232-d5eed595ad18 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:29:57 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6705e2-9527-4859-89be-1a716ede4210]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:57 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 Jul 06 12:29:57 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:58 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18" returned: 0 in 0.891s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:58 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37 1G Jul 06 12:29:58 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:59 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37 1G" returned: 0 in 0.934s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:59 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37 Jul 06 12:29:59 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:59 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37" returned: 0 in 0.859s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:59 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37 is being set with open permissions: ugo+rw Jul 06 12:29:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:59 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37 Jul 06 12:29:59 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:00 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37" returned: 0 in 0.751s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:00 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.info Jul 06 12:30:00 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:01 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.info" returned: 0 in 0.755s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:01 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.info is being set with open permissions: ugo+rw Jul 06 12:30:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:01 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.info Jul 06 12:30:01 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:02 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.info" returned: 0 in 0.862s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.163s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:02 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0ac7b766-b1d2-4b35-bdaf-02b8710a4399 tempest-CinderUnicodeTest-1560295512 None] Create snapshot completed successfully Jul 06 12:30:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Acquiring lock "cinder-d67585db-52ef-49cd-9ffc-f5356fc38f37-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Lock "cinder-d67585db-52ef-49cd-9ffc-f5356fc38f37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Acquiring lock "cinder-quobyte-a434e4a7-8b51-4dc4-a232-d5eed595ad18" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Lock "cinder-quobyte-a434e4a7-8b51-4dc4-a232-d5eed595ad18" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Acquiring lock "cinder-quobyte-d67585db-52ef-49cd-9ffc-f5356fc38f37" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Lock "cinder-quobyte-d67585db-52ef-49cd-9ffc-f5356fc38f37" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Deleting offline snapshot d67585db-52ef-49cd-9ffc-f5356fc38f37 of volume a434e4a7-8b51-4dc4-a232-d5eed595ad18 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:30:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] snapshot_file for this snap is: volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:30:03 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d190473-9502-47f7-9645-4ac8bf3718b4]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:03 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37 Jul 06 12:30:03 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:04 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37" returned: 0 in 0.915s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:30:04 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[833362f5-d3e4-41e4-ab73-aa33c9b4fda3]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:04 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 Jul 06 12:30:04 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:05 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18" returned: 0 in 0.825s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:05 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37 Jul 06 12:30:05 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:06 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37" returned: 0 in 0.881s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:06 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37 Jul 06 12:30:06 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:07 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18.d67585db-52ef-49cd-9ffc-f5356fc38f37" returned: 0 in 0.786s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Lock "cinder-quobyte-d67585db-52ef-49cd-9ffc-f5356fc38f37" released by "_delete_snapshot" :: held 3.526s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Lock "cinder-quobyte-a434e4a7-8b51-4dc4-a232-d5eed595ad18" released by "delete_snapshot" :: held 3.558s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:07 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Created reservations ['e101bf9f-c106-4bcd-96dd-d8da65a1c758', '94ff5b0e-828e-412f-a3d0-663f927c26f0', '35d2cc1d-f242-41ee-9da7-98f624b120d2', '60dbdbda-e01d-46a5-b159-03459d26d471'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:07 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Delete snapshot completed successfully. Jul 06 12:30:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4f7b95c5-94c8-4fb0-bcfa-9a2cba6f0aa0 tempest-CinderUnicodeTest-1560295512 None] Lock "cinder-d67585db-52ef-49cd-9ffc-f5356fc38f37-delete_snapshot" released by "delete_snapshot" :: held 3.745s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Acquiring lock "cinder-a434e4a7-8b51-4dc4-a232-d5eed595ad18-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Lock "cinder-a434e4a7-8b51-4dc4-a232-d5eed595ad18-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Acquiring lock "cinder-quobyte-a434e4a7-8b51-4dc4-a232-d5eed595ad18" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Lock "cinder-quobyte-a434e4a7-8b51-4dc4-a232-d5eed595ad18" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:07 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a522d81-9bfd-4ea6-bafe-a6f1081e8ce3]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:08 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 Jul 06 12:30:08 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:08 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18" returned: 0 in 1.010s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:08 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18 Jul 06 12:30:08 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:09 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a434e4a7-8b51-4dc4-a232-d5eed595ad18" returned: 0 in 0.708s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Lock "cinder-quobyte-a434e4a7-8b51-4dc4-a232-d5eed595ad18" released by "delete_volume" :: held 1.812s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:09 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Created reservations ['15f5bfff-1e06-4151-9617-4a05595e4d3c', '4c6768c2-7698-4846-a80a-617459e75cad', 'cc3f8a0a-23aa-456f-a692-9d75241dfba6', '571b6a04-cf72-41dd-9878-aca34b55fd84'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:09 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:30:09 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Acquiring lock "cinder-40d65896-9725-4858-8863-f511e5ded88a-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Lock "cinder-40d65896-9725-4858-8863-f511e5ded88a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Acquiring lock "cinder-quobyte-40d65896-9725-4858-8863-f511e5ded88a" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Lock "cinder-quobyte-40d65896-9725-4858-8863-f511e5ded88a" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:10 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ff912f-dc4c-4913-821c-54c55a9b237b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40d65896-9725-4858-8863-f511e5ded88a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:10 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40d65896-9725-4858-8863-f511e5ded88a Jul 06 12:30:10 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:10 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.945s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:10 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:10 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Deleted volume successfully. Jul 06 12:30:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-2fbd27a4-e679-43cb-92ee-891bb9350df4 tempest-CinderUnicodeTest-1560295512 None] Lock "cinder-a434e4a7-8b51-4dc4-a232-d5eed595ad18-delete_volume" released by "delete_volume" :: held 3.030s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:11 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40d65896-9725-4858-8863-f511e5ded88a" returned: 0 in 1.034s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40d65896-9725-4858-8863-f511e5ded88a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:11 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40d65896-9725-4858-8863-f511e5ded88a Jul 06 12:30:11 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:12 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-40d65896-9725-4858-8863-f511e5ded88a" returned: 0 in 0.741s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Lock "cinder-quobyte-40d65896-9725-4858-8863-f511e5ded88a" released by "delete_volume" :: held 1.832s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:12 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Created reservations ['e0317c1f-c4e0-4334-b115-a3ff2d75f547', '0288af6b-184c-46d1-a713-fda770554bd0', 'ab4d2594-aa7f-4a22-8bc8-a9807ed443a4', '31ba924f-1d97-4ed2-8d28-4867e4460f38'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:12 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:30:12 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:13 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.916s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:13 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:13 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Deleted volume successfully. Jul 06 12:30:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-96c09bdf-b269-4f07-9dd2-535c8dbb6c1e tempest-CinderUnicodeTest-1560295512 None] Lock "cinder-40d65896-9725-4858-8863-f511e5ded88a-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:17 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:30:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Flow 'volume_create_manager' (391d4797-6c8a-4d88-9d6e-b2890eccf464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290d07e9-77c6-436f-a335-178782ab3b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290d07e9-77c6-436f-a335-178782ab3b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1395490537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e29020e-670c-4a58-91f2-df69c25b2648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0fe9cce9124510824a08c97919dbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:30:18Z,use_quota=True,user_id='8c58f860a1cf4044a46023472e3c852a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec588b3c-a748-4f6e-ba55-1e36cade884d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec588b3c-a748-4f6e-ba55-1e36cade884d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371c0b73-1679-4165-a790-d032e69c4a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:17 devstack cinder-volume[86761]: DEBUG cinder.image.glance [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Creating Keystone auth plugin from conf {{(pid=86761) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:30:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371c0b73-1679-4165-a790-d032e69c4a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4e29020e-670c-4a58-91f2-df69c25b2648', 'volume_name': 'volume-4e29020e-670c-4a58-91f2-df69c25b2648', 'volume_size': 1, 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ecb593f86ab340bf8964e10d312ba960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1b7ac1-804f-463c-b740-08524be968f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1b7ac1-804f-463c-b740-08524be968f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8910752-5d0d-4849-bebf-2360d6c0972a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:18 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Volume 4e29020e-670c-4a58-91f2-df69c25b2648: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4e29020e-670c-4a58-91f2-df69c25b2648', 'volume_size': 1, 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ecb593f86ab340bf8964e10d312ba960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 12:30:18 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Trying to clone 4e29020e-670c-4a58-91f2-df69c25b2648 from image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]). {{(pid=86761) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:30:18 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_x33_k7yodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:30:18 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Image download 20.69 MB at 20.69 MB/s Jul 06 12:30:18 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[461e3c53-0615-4aa4-9f4f-90fe30b68363]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_x33_k7yodevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:18 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_x33_k7yodevstack@QuobyteHD Jul 06 12:30:18 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:19 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_x33_k7yodevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:19 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Temporary image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 is fetched for user 8c58f860a1cf4044a46023472e3c852a. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:30:19 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9f09f0-963d-4a7d-ac4a-9730c8cdd9b1]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_x33_k7yodevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:19 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_x33_k7yodevstack@QuobyteHD Jul 06 12:30:19 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:20 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_x33_k7yodevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1395490537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e29020e-670c-4a58-91f2-df69c25b2648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0fe9cce9124510824a08c97919dbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:30:18Z,use_quota=True,user_id='8c58f860a1cf4044a46023472e3c852a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:30:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Creating volume 4e29020e-670c-4a58-91f2-df69c25b2648 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:30:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:30:20 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:30:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:20 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 1073741824 Jul 06 12:30:20 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:21 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 1073741824" returned: 0 in 0.780s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:21 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 Jul 06 12:30:21 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:21 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648" returned: 0 in 0.667s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:30:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:21 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Attempting download of 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}])) to volume 4e29020e-670c-4a58-91f2-df69c25b2648. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:30:21 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc54c15b-ce77-4aa3-9a3f-d528ae1269db]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_6exotkyl {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:21 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_6exotkyl Jul 06 12:30:21 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:22 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_6exotkyl" returned: 0 in 0.723s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_6exotkyl {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:22 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_6exotkyl Jul 06 12:30:22 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:23 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_6exotkyl" returned: 1 in 0.726s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_6exotkyl' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:30:23 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa802bf-4667-40e7-a727-102c1d1ad1c7]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_x33_k7yodevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:23 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_x33_k7yodevstack@QuobyteHD Jul 06 12:30:23 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:23 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_x33_k7yodevstack@QuobyteHD" returned: 0 in 0.738s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:24 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 was qcow2, converting to raw {{(pid=86761) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:30:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_x33_k7yodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:24 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_x33_k7yodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 Jul 06 12:30:24 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:25 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_x33_k7yodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648" returned: 0 in 1.876s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:25 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2bb51d4a-9722-4ea7-be75-ebb2b5a045d6_x33_k7yodevstack@QuobyteHD, size 112.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:30:25 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Converted 112.00 MB image at 59.66 MB/s Jul 06 12:30:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:25 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 1G Jul 06 12:30:25 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:26 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 1G" returned: 0 in 0.754s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:26 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9632389-31d9-4656-95f9-bc8001c570ec]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:26 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 Jul 06 12:30:26 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:27 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648" returned: 0 in 0.764s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:27 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 Jul 06 12:30:27 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:28 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648" returned: 1 in 0.748s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:30:28 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Downloaded image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}])) to volume 4e29020e-670c-4a58-91f2-df69c25b2648 successfully. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:30:28 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Temporary image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 for user 8c58f860a1cf4044a46023472e3c852a is deleted. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:30:28 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Marking volume 4e29020e-670c-4a58-91f2-df69c25b2648 as bootable. {{(pid=86761) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:30:28 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Copying metadata from image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 to 4e29020e-670c-4a58-91f2-df69c25b2648. {{(pid=86761) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:30:28 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Creating volume glance metadata for volume 4e29020e-670c-4a58-91f2-df69c25b2648 backed by image 2bb51d4a-9722-4ea7-be75-ebb2b5a045d6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86761) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:30:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8910752-5d0d-4849-bebf-2360d6c0972a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e29020e-670c-4a58-91f2-df69c25b2648', 'volume_size': 1, 'image_id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ecb593f86ab340bf8964e10d312ba960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2bb51d4a-9722-4ea7-be75-ebb2b5a045d6', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bb51d4a-9722-4ea7-be75-ebb2b5a045d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb77736e-69ab-4059-b912-eb8432c819b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:28 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Volume volume-4e29020e-670c-4a58-91f2-df69c25b2648 (4e29020e-670c-4a58-91f2-df69c25b2648): created successfully Jul 06 12:30:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb77736e-69ab-4059-b912-eb8432c819b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Flow 'volume_create_manager' (391d4797-6c8a-4d88-9d6e-b2890eccf464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:28 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-90cbd38c-d922-451d-b3da-6c7996c7509e tempest-TestShelveInstance-1779828338 None] Created volume successfully. Jul 06 12:30:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-7eeb4880-00b5-4b9f-944b-6c7a1a18e76f req-43ab86e9-4383-4884-9295-f98ae61f2bc8 tempest-TestShelveInstance-1779828338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-7eeb4880-00b5-4b9f-944b-6c7a1a18e76f req-43ab86e9-4383-4884-9295-f98ae61f2bc8 tempest-TestShelveInstance-1779828338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:36 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1ec6d2-0bca-4507-8e85-15462aa07bd1]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-7eeb4880-00b5-4b9f-944b-6c7a1a18e76f req-43ab86e9-4383-4884-9295-f98ae61f2bc8 tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:36 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 Jul 06 12:30:36 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:37 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-7eeb4880-00b5-4b9f-944b-6c7a1a18e76f req-43ab86e9-4383-4884-9295-f98ae61f2bc8 tempest-TestShelveInstance-1779828338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648" returned: 0 in 0.817s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-7eeb4880-00b5-4b9f-944b-6c7a1a18e76f req-43ab86e9-4383-4884-9295-f98ae61f2bc8 tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:37 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 Jul 06 12:30:37 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:38 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-7eeb4880-00b5-4b9f-944b-6c7a1a18e76f req-43ab86e9-4383-4884-9295-f98ae61f2bc8 tempest-TestShelveInstance-1779828338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648" returned: 1 in 0.754s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-7eeb4880-00b5-4b9f-944b-6c7a1a18e76f req-43ab86e9-4383-4884-9295-f98ae61f2bc8 tempest-TestShelveInstance-1779828338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:30:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-7eeb4880-00b5-4b9f-944b-6c7a1a18e76f req-43ab86e9-4383-4884-9295-f98ae61f2bc8 tempest-TestShelveInstance-1779828338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.618s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-7eeb4880-00b5-4b9f-944b-6c7a1a18e76f req-43ab86e9-4383-4884-9295-f98ae61f2bc8 tempest-TestShelveInstance-1779828338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-4e29020e-670c-4a58-91f2-df69c25b2648', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98ca1f4a-adbe-439e-92ea-4e26b924772b', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:30:38 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-7eeb4880-00b5-4b9f-944b-6c7a1a18e76f req-43ab86e9-4383-4884-9295-f98ae61f2bc8 tempest-TestShelveInstance-1779828338 None] attachment_update completed successfully. Jul 06 12:30:48 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=41,cinder:UPDATE=26,cinder:INSERT=11,cinder:DELETE=2 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:30:48 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=30,cinder:UPDATE=37,cinder:INSERT=17,cinder:DELETE=3 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:30:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:30:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:52 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:30:52 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:53 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.722s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:30:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:30:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:31:15 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-caf68e5b-55f9-4d1a-a6d5-ccda1a0a65a9 req-522b2eff-fcf8-4436-bb37-aad36aafc557 tempest-TestShelveInstance-1779828338 None] Terminate volume connection completed successfully. Jul 06 12:31:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-caf68e5b-55f9-4d1a-a6d5-ccda1a0a65a9 req-522b2eff-fcf8-4436-bb37-aad36aafc557 tempest-TestShelveInstance-1779828338 None] Deleting attachment 98ca1f4a-adbe-439e-92ea-4e26b924772b. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:31:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-070c79de-fd49-4925-b393-72c9e6590679 req-42463a04-6951-4412-9885-344e3ba8ca8d tempest-TestShelveInstance-1779828338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-070c79de-fd49-4925-b393-72c9e6590679 req-42463a04-6951-4412-9885-344e3ba8ca8d tempest-TestShelveInstance-1779828338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:21 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ec7e87-4e61-4426-ae33-c33b0b0839de]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-070c79de-fd49-4925-b393-72c9e6590679 req-42463a04-6951-4412-9885-344e3ba8ca8d tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:21 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 Jul 06 12:31:21 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:22 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-070c79de-fd49-4925-b393-72c9e6590679 req-42463a04-6951-4412-9885-344e3ba8ca8d tempest-TestShelveInstance-1779828338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648" returned: 0 in 0.816s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-070c79de-fd49-4925-b393-72c9e6590679 req-42463a04-6951-4412-9885-344e3ba8ca8d tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:22 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 Jul 06 12:31:22 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:23 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-070c79de-fd49-4925-b393-72c9e6590679 req-42463a04-6951-4412-9885-344e3ba8ca8d tempest-TestShelveInstance-1779828338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648" returned: 1 in 0.788s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-070c79de-fd49-4925-b393-72c9e6590679 req-42463a04-6951-4412-9885-344e3ba8ca8d tempest-TestShelveInstance-1779828338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:31:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-070c79de-fd49-4925-b393-72c9e6590679 req-42463a04-6951-4412-9885-344e3ba8ca8d tempest-TestShelveInstance-1779828338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.647s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-070c79de-fd49-4925-b393-72c9e6590679 req-42463a04-6951-4412-9885-344e3ba8ca8d tempest-TestShelveInstance-1779828338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a', 'name': 'volume-4e29020e-670c-4a58-91f2-df69c25b2648', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '231c0ee7-c854-410f-a45d-cabea4614cd6', 'enforce_multipath': True} {{(pid=86761) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:31:23 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-070c79de-fd49-4925-b393-72c9e6590679 req-42463a04-6951-4412-9885-344e3ba8ca8d tempest-TestShelveInstance-1779828338 None] attachment_update completed successfully. Jul 06 12:31:33 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:31:36 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:31:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:31:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:52 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:31:52 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:53 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.738s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:31:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:31:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:31:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:32:04 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c67545d1-62d5-43a1-8fcc-fb16d1b2e550 tempest-TestShelveInstance-1779828338 None] Terminate volume connection completed successfully. Jul 06 12:32:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c67545d1-62d5-43a1-8fcc-fb16d1b2e550 tempest-TestShelveInstance-1779828338 None] Deleting attachment 231c0ee7-c854-410f-a45d-cabea4614cd6. {{(pid=86761) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:32:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Acquiring lock "cinder-4e29020e-670c-4a58-91f2-df69c25b2648-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Lock "cinder-4e29020e-670c-4a58-91f2-df69c25b2648-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Acquiring lock "cinder-quobyte-4e29020e-670c-4a58-91f2-df69c25b2648" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Lock "cinder-quobyte-4e29020e-670c-4a58-91f2-df69c25b2648" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:05 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b1867d-ea00-4018-b5c1-6e9255365b3a]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:05 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 Jul 06 12:32:05 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:05 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648" returned: 0 in 0.867s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:06 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 Jul 06 12:32:06 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:06 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648" returned: 1 in 0.886s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:32:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:06 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648 Jul 06 12:32:06 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:07 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4e29020e-670c-4a58-91f2-df69c25b2648" returned: 0 in 0.726s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Lock "cinder-quobyte-4e29020e-670c-4a58-91f2-df69c25b2648" released by "delete_volume" :: held 2.556s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:07 devstack cinder-volume[86761]: DEBUG cinder.quota [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Created reservations ['8de278f2-81ff-4b3e-b30b-8a07460437aa', 'e33db521-6310-4de5-b3c1-50ec8c9ed043', 'e2aa0373-bf60-499a-bdb8-05348fa84711', '697aab29-d238-487e-bcae-8ff3db944b1c'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:07 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:32:07 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:08 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.840s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:08 devstack cinder-volume[86761]: DEBUG cinder.manager [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:08 devstack cinder-volume[86761]: INFO cinder.volume.manager [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Deleted volume successfully. Jul 06 12:32:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [req-20c2ab69-f1d8-462e-a6af-b54677792155 req-c2661f93-60c0-4df8-b9dd-af97c79304ae tempest-TestShelveInstance-1779828338 None] Lock "cinder-4e29020e-670c-4a58-91f2-df69c25b2648-delete_volume" released by "delete_volume" :: held 3.656s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:17 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=6,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:32:18 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:32:20 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Flow 'volume_create_manager' (173e838f-8c83-4110-81e9-9ca80019b872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9310892-c0c3-4f6d-9946-62fc23ebea00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9310892-c0c3-4f6d-9946-62fc23ebea00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-679335503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a93376a-a528-4539-b65d-12f43e987ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1cdecb97d343a482ca4af7413c0775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:21Z,use_quota=True,user_id='e2ba8afbc9c645ea948b5250602ff923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4330efb-8cb9-4557-9aef-03929a110fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4330efb-8cb9-4557-9aef-03929a110fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b2020f-6b65-4ada-9675-f3de8fea97dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b2020f-6b65-4ada-9675-f3de8fea97dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a93376a-a528-4539-b65d-12f43e987ea7', 'volume_name': 'volume-2a93376a-a528-4539-b65d-12f43e987ea7', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86e7f9e-6fee-42b6-ab4e-0d851844a345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86e7f9e-6fee-42b6-ab4e-0d851844a345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c01c716-cbc9-42bb-aac3-49ead108fcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:21 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume 2a93376a-a528-4539-b65d-12f43e987ea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a93376a-a528-4539-b65d-12f43e987ea7', 'volume_size': 1} Jul 06 12:32:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-679335503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a93376a-a528-4539-b65d-12f43e987ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1cdecb97d343a482ca4af7413c0775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:21Z,use_quota=True,user_id='e2ba8afbc9c645ea948b5250602ff923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Creating volume 2a93376a-a528-4539-b65d-12f43e987ea7 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:21 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:32:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a93376a-a528-4539-b65d-12f43e987ea7 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:21 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a93376a-a528-4539-b65d-12f43e987ea7 1073741824 Jul 06 12:32:21 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:21 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a93376a-a528-4539-b65d-12f43e987ea7 1073741824" returned: 0 in 0.860s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a93376a-a528-4539-b65d-12f43e987ea7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:21 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a93376a-a528-4539-b65d-12f43e987ea7 Jul 06 12:32:21 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:22 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a93376a-a528-4539-b65d-12f43e987ea7" returned: 0 in 0.681s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c01c716-cbc9-42bb-aac3-49ead108fcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a93376a-a528-4539-b65d-12f43e987ea7', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3109d875-7752-4f0d-bb19-0df5cb69bdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:22 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume volume-2a93376a-a528-4539-b65d-12f43e987ea7 (2a93376a-a528-4539-b65d-12f43e987ea7): created successfully Jul 06 12:32:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3109d875-7752-4f0d-bb19-0df5cb69bdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Flow 'volume_create_manager' (173e838f-8c83-4110-81e9-9ca80019b872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:22 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-5f951a60-fd77-470d-b5c8-1b584c728469 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Created volume successfully. Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Flow 'volume_create_manager' (7637af84-d792-4ad6-93ae-0708bc77f9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc759438-56db-4c33-84f5-c3919cde983d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc759438-56db-4c33-84f5-c3919cde983d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-559846416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9140f75-34ba-467e-a669-dae0718dae92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1cdecb97d343a482ca4af7413c0775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:23Z,use_quota=True,user_id='e2ba8afbc9c645ea948b5250602ff923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a03438e-6b33-4ce0-b7af-ba176b56083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a03438e-6b33-4ce0-b7af-ba176b56083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4afb1f-7921-4412-96c1-ac07ab6fb1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4afb1f-7921-4412-96c1-ac07ab6fb1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9140f75-34ba-467e-a669-dae0718dae92', 'volume_name': 'volume-d9140f75-34ba-467e-a669-dae0718dae92', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0382894-da41-4537-9707-f16f8eda0c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0382894-da41-4537-9707-f16f8eda0c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346ad902-0b4e-4e0f-b18c-0159a9eeda1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:23 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume d9140f75-34ba-467e-a669-dae0718dae92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9140f75-34ba-467e-a669-dae0718dae92', 'volume_size': 1} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-559846416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9140f75-34ba-467e-a669-dae0718dae92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1cdecb97d343a482ca4af7413c0775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:23Z,use_quota=True,user_id='e2ba8afbc9c645ea948b5250602ff923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Creating volume d9140f75-34ba-467e-a669-dae0718dae92 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:23 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9140f75-34ba-467e-a669-dae0718dae92 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:23 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9140f75-34ba-467e-a669-dae0718dae92 1073741824 Jul 06 12:32:23 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Flow 'volume_create_manager' (c0060232-3db3-42f7-8f5d-3a32c2b85f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7699bbb-639d-4848-8e3b-de77c42184c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7699bbb-639d-4848-8e3b-de77c42184c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-515000828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9843d7fc-dd4a-4ec5-9663-37dba3e4cb59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1cdecb97d343a482ca4af7413c0775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:24Z,use_quota=True,user_id='e2ba8afbc9c645ea948b5250602ff923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf9e9d0-b9cf-4120-91a6-c8854bdef516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf9e9d0-b9cf-4120-91a6-c8854bdef516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6724c9-2a3b-4e2a-b31b-a5441a1861d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6724c9-2a3b-4e2a-b31b-a5441a1861d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9843d7fc-dd4a-4ec5-9663-37dba3e4cb59', 'volume_name': 'volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284fc844-841c-4431-8f3e-b927107f185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284fc844-841c-4431-8f3e-b927107f185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c506db-a343-4789-85da-76e039b15a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume 9843d7fc-dd4a-4ec5-9663-37dba3e4cb59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59', 'volume_size': 1} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Flow 'volume_create_manager' (38a2ec43-e333-42ae-a566-6184977bab74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249cc116-af1d-4733-9e52-3da88b7b3286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249cc116-af1d-4733-9e52-3da88b7b3286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312905894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f607fb-90d5-4b60-81e1-1b7d1fa29a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1cdecb97d343a482ca4af7413c0775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:24Z,use_quota=True,user_id='e2ba8afbc9c645ea948b5250602ff923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9485362d-e2af-4317-84a5-632c6ba7820e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9485362d-e2af-4317-84a5-632c6ba7820e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2449aafe-f6ec-4253-997c-532e539b254a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2449aafe-f6ec-4253-997c-532e539b254a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f607fb-90d5-4b60-81e1-1b7d1fa29a17', 'volume_name': 'volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e061587-be4e-4a27-8c33-7d1d405ffbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e061587-be4e-4a27-8c33-7d1d405ffbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ccf51f0-3ca9-4321-826a-b72f63750eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume c4f607fb-90d5-4b60-81e1-1b7d1fa29a17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17', 'volume_size': 1} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:24 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9140f75-34ba-467e-a669-dae0718dae92 1073741824" returned: 0 in 1.021s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9140f75-34ba-467e-a669-dae0718dae92 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:24 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9140f75-34ba-467e-a669-dae0718dae92 Jul 06 12:32:24 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Flow 'volume_create_manager' (fc6e30a9-b0d5-458d-9dc2-bf40c20b3e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5dcf69-8770-4b98-a5f7-b66fd1210124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5dcf69-8770-4b98-a5f7-b66fd1210124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1931973706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7a80d1-116e-4128-93a5-8f7ba6703fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1cdecb97d343a482ca4af7413c0775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:25Z,use_quota=True,user_id='e2ba8afbc9c645ea948b5250602ff923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e78bc2-a39a-4902-a28a-81b8fd37de23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e78bc2-a39a-4902-a28a-81b8fd37de23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e3fa2d-575e-46bc-8f7a-63d08f63a1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e3fa2d-575e-46bc-8f7a-63d08f63a1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c7a80d1-116e-4128-93a5-8f7ba6703fc5', 'volume_name': 'volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8f1d9b-5a6d-41a3-8d04-0a57582d6f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8f1d9b-5a6d-41a3-8d04-0a57582d6f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e20c00-c0b7-468e-8496-046a8c91a085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume 4c7a80d1-116e-4128-93a5-8f7ba6703fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5', 'volume_size': 1} Jul 06 12:32:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Flow 'volume_create_manager' (ae9daa77-574c-4bb8-b12e-f1233bc1d839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b4b5ba-364f-4b58-944b-60cb519af135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b4b5ba-364f-4b58-944b-60cb519af135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1857913769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ca3523-e2a1-4499-bb19-b6c4df7edcac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1cdecb97d343a482ca4af7413c0775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:25Z,use_quota=True,user_id='e2ba8afbc9c645ea948b5250602ff923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f036cc0-8ff8-4a07-b554-a90aca5ff763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f036cc0-8ff8-4a07-b554-a90aca5ff763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37aa85a0-b7d6-46c6-92c6-d919dde02cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37aa85a0-b7d6-46c6-92c6-d919dde02cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23ca3523-e2a1-4499-bb19-b6c4df7edcac', 'volume_name': 'volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde3422b-ac14-4cb1-9204-4226d9933e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde3422b-ac14-4cb1-9204-4226d9933e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34382f64-0da7-4241-9695-fa1ec96b5a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:25 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume 23ca3523-e2a1-4499-bb19-b6c4df7edcac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac', 'volume_size': 1} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:25 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9140f75-34ba-467e-a669-dae0718dae92" returned: 0 in 0.742s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.389s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-515000828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9843d7fc-dd4a-4ec5-9663-37dba3e4cb59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1cdecb97d343a482ca4af7413c0775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:24Z,use_quota=True,user_id='e2ba8afbc9c645ea948b5250602ff923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Creating volume 9843d7fc-dd4a-4ec5-9663-37dba3e4cb59 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:25 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346ad902-0b4e-4e0f-b18c-0159a9eeda1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9140f75-34ba-467e-a669-dae0718dae92', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:25 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59 1073741824 Jul 06 12:32:25 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed90efd-4900-484d-a654-9e7956753e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:25 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume volume-d9140f75-34ba-467e-a669-dae0718dae92 (d9140f75-34ba-467e-a669-dae0718dae92): created successfully Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed90efd-4900-484d-a654-9e7956753e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Flow 'volume_create_manager' (7637af84-d792-4ad6-93ae-0708bc77f9ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:25 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-9ddfec0e-2a9f-4ef3-958b-6a9b67bb6f84 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Created volume successfully. Jul 06 12:32:26 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59 1073741824" returned: 0 in 1.057s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:26 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59 Jul 06 12:32:26 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:27 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59" returned: 0 in 0.779s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.729s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312905894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f607fb-90d5-4b60-81e1-1b7d1fa29a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1cdecb97d343a482ca4af7413c0775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:24Z,use_quota=True,user_id='e2ba8afbc9c645ea948b5250602ff923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Creating volume c4f607fb-90d5-4b60-81e1-1b7d1fa29a17 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:27 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c506db-a343-4789-85da-76e039b15a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea150ad-db26-49e5-96a8-8179cc69dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:27 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17 1073741824 Jul 06 12:32:27 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:27 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59 (9843d7fc-dd4a-4ec5-9663-37dba3e4cb59): created successfully Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea150ad-db26-49e5-96a8-8179cc69dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Flow 'volume_create_manager' (c0060232-3db3-42f7-8f5d-3a32c2b85f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:27 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-5fabe7dc-f638-4574-9c19-bbf5c0808681 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Created volume successfully. Jul 06 12:32:28 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17 1073741824" returned: 0 in 1.014s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:28 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17 Jul 06 12:32:28 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:29 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17" returned: 0 in 0.715s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.096s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1931973706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7a80d1-116e-4128-93a5-8f7ba6703fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1cdecb97d343a482ca4af7413c0775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:25Z,use_quota=True,user_id='e2ba8afbc9c645ea948b5250602ff923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Creating volume 4c7a80d1-116e-4128-93a5-8f7ba6703fc5 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:29 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:29 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5 1073741824 Jul 06 12:32:29 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ccf51f0-3ca9-4321-826a-b72f63750eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc650bd-1ecd-458d-8543-020422333b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:29 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17 (c4f607fb-90d5-4b60-81e1-1b7d1fa29a17): created successfully Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc650bd-1ecd-458d-8543-020422333b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Flow 'volume_create_manager' (38a2ec43-e333-42ae-a566-6184977bab74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:29 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ee0aea62-4dd7-474b-8aeb-d2d5bada52d9 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Created volume successfully. Jul 06 12:32:30 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5 1073741824" returned: 0 in 0.936s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:30 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5 Jul 06 12:32:30 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:30 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5" returned: 0 in 0.702s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.417s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1857913769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ca3523-e2a1-4499-bb19-b6c4df7edcac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1cdecb97d343a482ca4af7413c0775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:25Z,use_quota=True,user_id='e2ba8afbc9c645ea948b5250602ff923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Creating volume 23ca3523-e2a1-4499-bb19-b6c4df7edcac {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:30 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:30 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac 1073741824 Jul 06 12:32:30 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e20c00-c0b7-468e-8496-046a8c91a085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17dbdda1-8f10-4d13-96ec-31b710142f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:30 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5 (4c7a80d1-116e-4128-93a5-8f7ba6703fc5): created successfully Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17dbdda1-8f10-4d13-96ec-31b710142f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Flow 'volume_create_manager' (fc6e30a9-b0d5-458d-9dc2-bf40c20b3e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:30 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-64e75910-70b8-4d21-b26b-64cce7c67209 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Created volume successfully. Jul 06 12:32:31 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac 1073741824" returned: 0 in 0.884s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:31 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac Jul 06 12:32:31 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:32 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac" returned: 0 in 0.705s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34382f64-0da7-4241-9695-fa1ec96b5a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f7f59f-e976-48a7-bae1-8d04398246fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:32 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Volume volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac (23ca3523-e2a1-4499-bb19-b6c4df7edcac): created successfully Jul 06 12:32:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f7f59f-e976-48a7-bae1-8d04398246fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Flow 'volume_create_manager' (ae9daa77-574c-4bb8-b12e-f1233bc1d839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:32 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-15678132-f6d9-470e-9acf-3da21e4aaf33 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Created volume successfully. Jul 06 12:32:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "cinder-23ca3523-e2a1-4499-bb19-b6c4df7edcac-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-23ca3523-e2a1-4499-bb19-b6c4df7edcac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "cinder-quobyte-23ca3523-e2a1-4499-bb19-b6c4df7edcac" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-quobyte-23ca3523-e2a1-4499-bb19-b6c4df7edcac" acquired by "delete_volume" :: waited 0.013s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:33 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a207fdd-7771-43a7-a9df-7743c366d8f0]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:33 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac Jul 06 12:32:33 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:33 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac" returned: 0 in 0.798s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:33 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac Jul 06 12:32:33 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:34 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23ca3523-e2a1-4499-bb19-b6c4df7edcac" returned: 0 in 0.711s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-quobyte-23ca3523-e2a1-4499-bb19-b6c4df7edcac" released by "delete_volume" :: held 1.556s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:34 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Created reservations ['4d03e373-8f32-48c4-80de-8733092247cc', '9be5b023-7115-4c08-b633-82779fb7471b', 'd4eeb9a8-ffaf-4578-885d-29eeb0e77c7c', '635ccdd0-1d22-4d64-a9dd-975ce2a4c5a4'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:34 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:34 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:34 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:32:34 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "cinder-4c7a80d1-116e-4128-93a5-8f7ba6703fc5-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-4c7a80d1-116e-4128-93a5-8f7ba6703fc5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "cinder-quobyte-4c7a80d1-116e-4128-93a5-8f7ba6703fc5" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-quobyte-4c7a80d1-116e-4128-93a5-8f7ba6703fc5" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:35 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[851255ab-3f08-4fd1-b929-46a0fd1f9c86]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:35 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.733s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:35 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5 Jul 06 12:32:35 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:35 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:35 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Deleted volume successfully. Jul 06 12:32:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c194cbdc-2bad-4b42-930a-a0281c09719a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-23ca3523-e2a1-4499-bb19-b6c4df7edcac-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:36 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5" returned: 0 in 0.765s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:36 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5 Jul 06 12:32:36 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:36 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4c7a80d1-116e-4128-93a5-8f7ba6703fc5" returned: 0 in 0.650s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-quobyte-4c7a80d1-116e-4128-93a5-8f7ba6703fc5" released by "delete_volume" :: held 1.465s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:36 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Created reservations ['f96ed987-1f5b-4838-9a8e-90feb93997a6', '2ba2e8b2-48c5-46bb-8135-e5079d3b9588', '9c51699b-af82-4c5e-865d-2ac3ff01de65', '7ff69944-93ab-4db6-9045-f1152b395e0b'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:37 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:32:37 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "cinder-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "cinder-quobyte-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-quobyte-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:37 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17b849a-7076-4f2d-8d6a-0b4b429043df]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:37 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.651s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:37 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:37 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Deleted volume successfully. Jul 06 12:32:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9b8f211d-e957-40dc-bd5e-52130ffbb71f tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-4c7a80d1-116e-4128-93a5-8f7ba6703fc5-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:37 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17 Jul 06 12:32:37 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:38 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17" returned: 0 in 0.765s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:38 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17 Jul 06 12:32:38 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:39 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17" returned: 0 in 0.661s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-quobyte-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17" released by "delete_volume" :: held 1.474s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Created reservations ['11920717-cf1b-40fb-9277-7f5a057d514d', 'd99db50b-8d11-4fc4-af63-01b0ebd3d9c7', 'eb256176-7f58-4047-9b0b-76e87dbde0b9', 'ce82f2a2-9426-4f19-b8c8-9df551eff0b0'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:39 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:32:39 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "cinder-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "cinder-quobyte-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-quobyte-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[486b0692-c4dc-4e80-b234-e49110aa3fd5]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:39 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.742s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:39 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Deleted volume successfully. Jul 06 12:32:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5f68809b-d687-485c-9013-e9d18c1ab830 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-c4f607fb-90d5-4b60-81e1-1b7d1fa29a17-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:40 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59 Jul 06 12:32:40 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:40 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59" returned: 0 in 0.850s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:40 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59 Jul 06 12:32:40 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:41 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59" returned: 0 in 0.693s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-quobyte-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59" released by "delete_volume" :: held 1.592s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:41 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Created reservations ['a0dd6174-b92d-44b6-867a-b5c716a1287c', '51e74028-e485-47e6-a0e0-dde58c82bca5', 'cdac30ab-61ed-44a3-ac9f-bb5296069eea', '4b7d733f-52b3-4ff8-bbdb-7b3ba1124a04'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:41 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:32:41 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "cinder-d9140f75-34ba-467e-a669-dae0718dae92-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-d9140f75-34ba-467e-a669-dae0718dae92-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "cinder-quobyte-d9140f75-34ba-467e-a669-dae0718dae92" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-quobyte-d9140f75-34ba-467e-a669-dae0718dae92" acquired by "delete_volume" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:42 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec5a323-bbcd-43e6-ac41-1f0ff7d6a146]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9140f75-34ba-467e-a669-dae0718dae92 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:42 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.647s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:42 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:42 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Deleted volume successfully. Jul 06 12:32:42 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9140f75-34ba-467e-a669-dae0718dae92 Jul 06 12:32:42 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4203e42a-1077-41b2-bdc7-9d7f31eaab4a tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-9843d7fc-dd4a-4ec5-9663-37dba3e4cb59-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:42 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9140f75-34ba-467e-a669-dae0718dae92" returned: 0 in 0.810s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9140f75-34ba-467e-a669-dae0718dae92 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:42 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9140f75-34ba-467e-a669-dae0718dae92 Jul 06 12:32:43 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:43 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d9140f75-34ba-467e-a669-dae0718dae92" returned: 0 in 0.726s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-quobyte-d9140f75-34ba-467e-a669-dae0718dae92" released by "delete_volume" :: held 1.581s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:43 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Created reservations ['f7cc6027-1fbe-4adc-837d-d924a32650ae', '157b4ab9-765b-4a7a-ac1e-49be891f2e96', 'f92b6b6c-88c3-47d4-8cd3-4add9b11042a', 'e7db3d8e-5a37-4461-ba48-cfa6c3950093'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:43 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:32:43 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "cinder-2a93376a-a528-4539-b65d-12f43e987ea7-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-2a93376a-a528-4539-b65d-12f43e987ea7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "cinder-quobyte-2a93376a-a528-4539-b65d-12f43e987ea7" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-quobyte-2a93376a-a528-4539-b65d-12f43e987ea7" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:44 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[815492d0-b8a2-4b70-9a54-abeb092291c2]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a93376a-a528-4539-b65d-12f43e987ea7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:44 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.700s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:44 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:44 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Deleted volume successfully. Jul 06 12:32:44 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a93376a-a528-4539-b65d-12f43e987ea7 Jul 06 12:32:44 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b881d2ec-c7dc-4904-9feb-f7955910dfa0 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-d9140f75-34ba-467e-a669-dae0718dae92-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:45 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a93376a-a528-4539-b65d-12f43e987ea7" returned: 0 in 0.843s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a93376a-a528-4539-b65d-12f43e987ea7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:45 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a93376a-a528-4539-b65d-12f43e987ea7 Jul 06 12:32:45 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:45 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a93376a-a528-4539-b65d-12f43e987ea7" returned: 0 in 0.662s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-quobyte-2a93376a-a528-4539-b65d-12f43e987ea7" released by "delete_volume" :: held 1.544s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:45 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Created reservations ['19e5c7a1-39b2-4928-a43e-eb41f0b24aef', '5dccc506-1c82-4138-a8ae-59580476ffab', '942fe642-f410-4a59-9b45-db148268ec12', '6d4b3ff6-e282-4f4f-b8bc-b312129b4ce9'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:46 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:32:46 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:46 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.733s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:46 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:46 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Deleted volume successfully. Jul 06 12:32:46 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-880ce917-8a6d-443a-9e19-4dfb05688379 tempest-CreateVolumesFromSourceVolumeTest-1679373494 None] Lock "cinder-2a93376a-a528-4539-b65d-12f43e987ea7-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Flow 'volume_create_manager' (551936fa-e76e-4084-ac63-8f2f90bc7fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef079513-c7d6-440c-b489-156b48f44a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef079513-c7d6-440c-b489-156b48f44a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1334764093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335bfe66-24f2-49ff-8078-15b761dc0a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc4129b462d44afac0d07134ba2b701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:50Z,use_quota=True,user_id='06eb90788c694714bca15d9e4803e850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db283890-d90b-4532-8e93-a0f9f92d4c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db283890-d90b-4532-8e93-a0f9f92d4c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238288be-eb14-4db3-bf34-ba654a3b0634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238288be-eb14-4db3-bf34-ba654a3b0634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '335bfe66-24f2-49ff-8078-15b761dc0a8c', 'volume_name': 'volume-335bfe66-24f2-49ff-8078-15b761dc0a8c', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9344e4ee-ce81-43d0-8f27-6326fa425222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9344e4ee-ce81-43d0-8f27-6326fa425222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adb99a5-5358-45ba-81cc-660ca718ab14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Volume 335bfe66-24f2-49ff-8078-15b761dc0a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-335bfe66-24f2-49ff-8078-15b761dc0a8c', 'volume_size': 1} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1334764093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335bfe66-24f2-49ff-8078-15b761dc0a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc4129b462d44afac0d07134ba2b701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:50Z,use_quota=True,user_id='06eb90788c694714bca15d9e4803e850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Creating volume 335bfe66-24f2-49ff-8078-15b761dc0a8c {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:49 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:32:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:50 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c 1073741824 Jul 06 12:32:50 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:50 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c 1073741824" returned: 0 in 0.837s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:50 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c Jul 06 12:32:50 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:51 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c" returned: 0 in 0.635s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:51 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adb99a5-5358-45ba-81cc-660ca718ab14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-335bfe66-24f2-49ff-8078-15b761dc0a8c', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653307d6-f4a1-4afb-b272-b8954d5e3a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:51 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Volume volume-335bfe66-24f2-49ff-8078-15b761dc0a8c (335bfe66-24f2-49ff-8078-15b761dc0a8c): created successfully Jul 06 12:32:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653307d6-f4a1-4afb-b272-b8954d5e3a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Flow 'volume_create_manager' (551936fa-e76e-4084-ac63-8f2f90bc7fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-8cff6066-bd11-4e98-bf46-e90a79a5152d tempest-VolumeDependencyTests-1380982191 None] Created volume successfully. Jul 06 12:32:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] Creating offline snapshot b84b6b90-ecf7-43f7-9343-71ab60bf39da of volume 335bfe66-24f2-49ff-8078-15b761dc0a8c {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:32:52 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d4fca6-8ddd-4e39-8764-2c35631b4c1c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:52 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c Jul 06 12:32:52 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:32:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:52 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:32:52 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:52 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c" returned: 0 in 0.804s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:52 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da 1G Jul 06 12:32:52 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:53 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.758s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:32:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:32:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:32:53 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da 1G" returned: 0 in 0.840s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335bfe66-24f2-49ff-8078-15b761dc0a8c -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:53 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335bfe66-24f2-49ff-8078-15b761dc0a8c -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da Jul 06 12:32:53 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:54 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335bfe66-24f2-49ff-8078-15b761dc0a8c -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da" returned: 0 in 0.676s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:54 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da is being set with open permissions: ugo+rw Jul 06 12:32:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:54 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da Jul 06 12:32:54 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:55 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da" returned: 0 in 0.667s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:55 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.info Jul 06 12:32:55 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:55 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.info" returned: 0 in 0.684s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:55 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.info is being set with open permissions: ugo+rw Jul 06 12:32:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:55 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.info Jul 06 12:32:55 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:56 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.info" returned: 0 in 0.660s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.423s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:56 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-fe05bc4a-d260-4579-abac-ecb417cb342e tempest-VolumeDependencyTests-1380982191 None] Create snapshot completed successfully Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Flow 'volume_create_manager' (4407fe7e-2fac-4911-b096-04d93d63c7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29bdd871-3a0a-45a6-a045-df754f354da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29bdd871-3a0a-45a6-a045-df754f354da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-984929112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e399d264-a308-443f-af9b-0fda8ff1f84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc4129b462d44afac0d07134ba2b701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b84b6b90-ecf7-43f7-9343-71ab60bf39da,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:58Z,use_quota=True,user_id='06eb90788c694714bca15d9e4803e850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a74a8c-4fa0-41dc-b6c8-64aff18d47dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a74a8c-4fa0-41dc-b6c8-64aff18d47dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9c8873-10b5-4757-bee0-d60db554299c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9c8873-10b5-4757-bee0-d60db554299c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e399d264-a308-443f-af9b-0fda8ff1f84d', 'volume_name': 'volume-e399d264-a308-443f-af9b-0fda8ff1f84d', 'volume_size': 1, 'snapshot_id': 'b84b6b90-ecf7-43f7-9343-71ab60bf39da'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bbaf81c-d6b8-40e9-85a1-0d1bc79151da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bbaf81c-d6b8-40e9-85a1-0d1bc79151da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1efe73-d1da-4586-ab9d-c4bf22f16eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:57 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Volume e399d264-a308-443f-af9b-0fda8ff1f84d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e399d264-a308-443f-af9b-0fda8ff1f84d', 'volume_size': 1, 'snapshot_id': 'b84b6b90-ecf7-43f7-9343-71ab60bf39da'} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "cinder-quobyte-b84b6b90-ecf7-43f7-9343-71ab60bf39da-e399d264-a308-443f-af9b-0fda8ff1f84d" by "_create_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-quobyte-b84b6b90-ecf7-43f7-9343-71ab60bf39da-e399d264-a308-443f-af9b-0fda8ff1f84d" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Creating volume e399d264-a308-443f-af9b-0fda8ff1f84d from snapshot b84b6b90-ecf7-43f7-9343-71ab60bf39da {{(pid=86761) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "cinder-quobyte-e399d264-a308-443f-af9b-0fda8ff1f84d" by "_copy_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-quobyte-e399d264-a308-443f-af9b-0fda8ff1f84d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] snapshot: b84b6b90-ecf7-43f7-9343-71ab60bf39da, volume: e399d264-a308-443f-af9b-0fda8ff1f84d, {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1d1600-045b-46d8-8602-34fdf2c9e08e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:58 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da Jul 06 12:32:58 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:58 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da" returned: 0 in 0.829s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-335bfe66-24f2-49ff-8078-15b761dc0a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Creating direct copy from snapshot {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf227d63-7cd4-4865-8f31-6dfae216bd4b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:59 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c Jul 06 12:32:59 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:59 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c" returned: 0 in 0.803s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:59 devstack cinder-volume[86761]: DEBUG cinder.utils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Path /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e399d264-a308-443f-af9b-0fda8ff1f84d not found in is_blk_device check {{(pid=86761) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:32:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e399d264-a308-443f-af9b-0fda8ff1f84d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:59 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e399d264-a308-443f-af9b-0fda8ff1f84d Jul 06 12:32:59 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:04 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e399d264-a308-443f-af9b-0fda8ff1f84d" returned: 0 in 4.630s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:04 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fa7c33-11f8-406e-a72a-dd74589f7f2a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:04 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c Jul 06 12:33:04 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:05 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c" returned: 0 in 1.000s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:05 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c, size 1024.00 MB, duration 4.63 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e399d264-a308-443f-af9b-0fda8ff1f84d {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:33:05 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Converted 1024.00 MB image at 221.13 MB/s Jul 06 12:33:05 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e399d264-a308-443f-af9b-0fda8ff1f84d is being set with open permissions: ugo+rw Jul 06 12:33:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e399d264-a308-443f-af9b-0fda8ff1f84d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:05 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e399d264-a308-443f-af9b-0fda8ff1f84d Jul 06 12:33:05 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:06 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e399d264-a308-443f-af9b-0fda8ff1f84d" returned: 0 in 0.726s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-quobyte-e399d264-a308-443f-af9b-0fda8ff1f84d" released by "_copy_volume_from_snapshot" :: held 8.085s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-quobyte-b84b6b90-ecf7-43f7-9343-71ab60bf39da-e399d264-a308-443f-af9b-0fda8ff1f84d" released by "_create_volume_from_snapshot" :: held 8.115s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.131s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1efe73-d1da-4586-ab9d-c4bf22f16eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e399d264-a308-443f-af9b-0fda8ff1f84d', 'volume_size': 1, 'snapshot_id': 'b84b6b90-ecf7-43f7-9343-71ab60bf39da'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48584657-cb3c-4b06-9433-54fb947d079e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:06 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Volume volume-e399d264-a308-443f-af9b-0fda8ff1f84d (e399d264-a308-443f-af9b-0fda8ff1f84d): created successfully Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48584657-cb3c-4b06-9433-54fb947d079e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Flow 'volume_create_manager' (4407fe7e-2fac-4911-b096-04d93d63c7c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:06 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-53961671-8c51-4f7e-842d-d1a03dbd7440 tempest-VolumeDependencyTests-1380982191 None] Created volume successfully. Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "cinder-b84b6b90-ecf7-43f7-9343-71ab60bf39da-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-b84b6b90-ecf7-43f7-9343-71ab60bf39da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "cinder-quobyte-335bfe66-24f2-49ff-8078-15b761dc0a8c" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-quobyte-335bfe66-24f2-49ff-8078-15b761dc0a8c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "cinder-quobyte-b84b6b90-ecf7-43f7-9343-71ab60bf39da" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-quobyte-b84b6b90-ecf7-43f7-9343-71ab60bf39da" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Deleting offline snapshot b84b6b90-ecf7-43f7-9343-71ab60bf39da of volume 335bfe66-24f2-49ff-8078-15b761dc0a8c {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] snapshot_file for this snap is: volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d321865-e121-4124-affe-140c60668101]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:06 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da Jul 06 12:33:06 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:07 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da" returned: 0 in 0.829s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-335bfe66-24f2-49ff-8078-15b761dc0a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:33:07 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49ad229-8330-45d8-ab79-f1a9885ef7d9]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:07 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c Jul 06 12:33:07 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:08 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c" returned: 0 in 0.827s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:08 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da Jul 06 12:33:08 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:09 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da" returned: 0 in 0.762s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:09 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da Jul 06 12:33:09 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:09 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c.b84b6b90-ecf7-43f7-9343-71ab60bf39da" returned: 0 in 0.637s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-quobyte-b84b6b90-ecf7-43f7-9343-71ab60bf39da" released by "_delete_snapshot" :: held 3.159s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-quobyte-335bfe66-24f2-49ff-8078-15b761dc0a8c" released by "delete_snapshot" :: held 3.182s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:09 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Created reservations ['8eabbceb-4209-4d0b-ae9f-8ce26ea85f5c', 'df904e1e-6127-42a1-88dd-6cc9a5da4405', '30a42a7f-b433-42e3-a278-22aef1f048a8', '47ecbd36-06ee-422d-b100-27b08a2358ec'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:09 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Delete snapshot completed successfully. Jul 06 12:33:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fa925652-7bbe-4d99-82fe-938a329ec49f tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-b84b6b90-ecf7-43f7-9343-71ab60bf39da-delete_snapshot" released by "delete_snapshot" :: held 3.321s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "cinder-335bfe66-24f2-49ff-8078-15b761dc0a8c-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-335bfe66-24f2-49ff-8078-15b761dc0a8c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "cinder-quobyte-335bfe66-24f2-49ff-8078-15b761dc0a8c" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-quobyte-335bfe66-24f2-49ff-8078-15b761dc0a8c" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:10 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af518b6-bedf-4cb9-9f99-415807b9c8b2]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:11 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c Jul 06 12:33:11 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:11 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c" returned: 0 in 0.833s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:11 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c Jul 06 12:33:11 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:12 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-335bfe66-24f2-49ff-8078-15b761dc0a8c" returned: 0 in 0.681s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-quobyte-335bfe66-24f2-49ff-8078-15b761dc0a8c" released by "delete_volume" :: held 1.581s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:12 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Created reservations ['87124585-d693-4d87-9921-1019df413b06', '16192670-8174-4e0f-9842-bfb75ebf0b78', '6e12fc44-fae9-44b2-96f5-ba8216c5958b', '1679739a-b74e-449d-940f-64534c9b1fb3'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:12 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:33:12 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "cinder-e399d264-a308-443f-af9b-0fda8ff1f84d-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-e399d264-a308-443f-af9b-0fda8ff1f84d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "cinder-quobyte-e399d264-a308-443f-af9b-0fda8ff1f84d" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-quobyte-e399d264-a308-443f-af9b-0fda8ff1f84d" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:13 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e82b97-377b-4757-a814-fb11e04153e0]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e399d264-a308-443f-af9b-0fda8ff1f84d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:13 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e399d264-a308-443f-af9b-0fda8ff1f84d Jul 06 12:33:13 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:13 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.746s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:13 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:33:13 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Deleted volume successfully. Jul 06 12:33:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4d73e03d-b65d-4b25-bd1f-24b3c2a1e06a tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-335bfe66-24f2-49ff-8078-15b761dc0a8c-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:13 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e399d264-a308-443f-af9b-0fda8ff1f84d" returned: 0 in 0.810s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e399d264-a308-443f-af9b-0fda8ff1f84d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:13 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e399d264-a308-443f-af9b-0fda8ff1f84d Jul 06 12:33:13 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:14 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e399d264-a308-443f-af9b-0fda8ff1f84d" returned: 0 in 0.640s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:14 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-quobyte-e399d264-a308-443f-af9b-0fda8ff1f84d" released by "delete_volume" :: held 1.495s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:14 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Created reservations ['df76b9df-1971-445d-9bb6-817bab76f118', '67d9104f-e1f2-41f3-a42b-ff87b517c028', '89837bba-5088-4e2b-b672-f76adcd5f086', '6d8116a3-95d2-470e-a3bd-b3c2b75b6b89'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:14 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:33:14 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:15 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.709s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:15 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:33:15 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Deleted volume successfully. Jul 06 12:33:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-10ebba25-0c40-4b59-9d26-ea0bdc2da3cf tempest-VolumeDependencyTests-1380982191 None] Lock "cinder-e399d264-a308-443f-af9b-0fda8ff1f84d-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:20 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=72,cinder:INSERT=22,cinder:DELETE=8,cinder:UPDATE=93 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:33:20 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=60,cinder:UPDATE=96,cinder:INSERT=22,cinder:DELETE=9 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:33:20 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:33:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Flow 'volume_create_manager' (40580909-f781-4203-9817-bf9359bae9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c05f21-62b7-4176-a0ea-e68856d41cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c05f21-62b7-4176-a0ea-e68856d41cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e3f32a-7c6c-4310-b395-3103edb813c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df69056720da424d9fd58aa2dfc1d100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:21Z,use_quota=True,user_id='ca54d2feadff467b9530378f806f09e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa16cc5-53f2-4486-b6ae-06acc159ad6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa16cc5-53f2-4486-b6ae-06acc159ad6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a7dd4dd-b1c4-456d-9c14-59f123af6c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:20 devstack cinder-volume[86761]: DEBUG cinder.image.glance [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Creating Keystone auth plugin from conf {{(pid=86761) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:33:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a7dd4dd-b1c4-456d-9c14-59f123af6c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '05e3f32a-7c6c-4310-b395-3103edb813c2', 'volume_name': 'volume-05e3f32a-7c6c-4310-b395-3103edb813c2', 'volume_size': 1, 'image_id': '81643be6-d7d0-4b79-8d52-bdcd230e5133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81643be6-d7d0-4b79-8d52-bdcd230e5133', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5671615fdb3fcb14aa41c69e6bf8c76e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df69056720da424d9fd58aa2dfc1d100', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '57a63419bfecb4c702bf291a236df8ae17340aca96a7ab6f304065c7c206f045d6130f040377487013fcbabb6007d6ac4083b121fe53c37ebe99b2f503ae5c7b', 'id': '81643be6-d7d0-4b79-8d52-bdcd230e5133', 'created_at': datetime.datetime(2026, 7, 6, 10, 33, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 33, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81643be6-d7d0-4b79-8d52-bdcd230e5133/file', 'properties': {}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccdb39e-b6ac-4161-a0a2-18537e794a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccdb39e-b6ac-4161-a0a2-18537e794a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349df080-e60f-43d1-afd5-8c739d8adf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:20 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Volume 05e3f32a-7c6c-4310-b395-3103edb813c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-05e3f32a-7c6c-4310-b395-3103edb813c2', 'volume_size': 1, 'image_id': '81643be6-d7d0-4b79-8d52-bdcd230e5133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81643be6-d7d0-4b79-8d52-bdcd230e5133', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5671615fdb3fcb14aa41c69e6bf8c76e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df69056720da424d9fd58aa2dfc1d100', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '57a63419bfecb4c702bf291a236df8ae17340aca96a7ab6f304065c7c206f045d6130f040377487013fcbabb6007d6ac4083b121fe53c37ebe99b2f503ae5c7b', 'id': '81643be6-d7d0-4b79-8d52-bdcd230e5133', 'created_at': datetime.datetime(2026, 7, 6, 10, 33, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 33, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81643be6-d7d0-4b79-8d52-bdcd230e5133/file', 'properties': {}}, 'image_service': } Jul 06 12:33:20 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Trying to clone 05e3f32a-7c6c-4310-b395-3103edb813c2 from image 81643be6-d7d0-4b79-8d52-bdcd230e5133 at location (None, [{'url': 'file:///opt/stack/data/glance/images/81643be6-d7d0-4b79-8d52-bdcd230e5133', 'metadata': {}}]). {{(pid=86761) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:33:21 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:33:21 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Image download 0.00 MB at 0.00 MB/s Jul 06 12:33:21 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d8a035-8412-476a-b1f5-5ffc51b7443b]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:21 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD Jul 06 12:33:21 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:21 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:21 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD Jul 06 12:33:21 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:22 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD" returned: 1 in 0.739s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:33:22 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Temporary image 81643be6-d7d0-4b79-8d52-bdcd230e5133 is fetched for user ca54d2feadff467b9530378f806f09e4. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:33:22 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6306a57-790c-4585-9fe0-648d93d98986]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:22 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD Jul 06 12:33:22 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:23 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD" returned: 0 in 0.795s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:23 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD Jul 06 12:33:23 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:24 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD" returned: 1 in 0.792s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:33:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e3f32a-7c6c-4310-b395-3103edb813c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df69056720da424d9fd58aa2dfc1d100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:21Z,use_quota=True,user_id='ca54d2feadff467b9530378f806f09e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:33:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Creating volume 05e3f32a-7c6c-4310-b395-3103edb813c2 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:33:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:33:24 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:33:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:24 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 1073741824 Jul 06 12:33:24 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:25 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 1073741824" returned: 0 in 0.945s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:25 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 Jul 06 12:33:25 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:25 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2" returned: 0 in 0.620s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:33:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:25 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Attempting download of 81643be6-d7d0-4b79-8d52-bdcd230e5133 ((None, [{'url': 'file:///opt/stack/data/glance/images/81643be6-d7d0-4b79-8d52-bdcd230e5133', 'metadata': {}}])) to volume 05e3f32a-7c6c-4310-b395-3103edb813c2. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:33:25 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f66b738-2aaf-4717-bb8e-6c61b48e4ee7]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81643be6-d7d0-4b79-8d52-bdcd230e5133_nejh2z3o {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:26 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81643be6-d7d0-4b79-8d52-bdcd230e5133_nejh2z3o Jul 06 12:33:26 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:26 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81643be6-d7d0-4b79-8d52-bdcd230e5133_nejh2z3o" returned: 0 in 0.765s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81643be6-d7d0-4b79-8d52-bdcd230e5133_nejh2z3o {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:26 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81643be6-d7d0-4b79-8d52-bdcd230e5133_nejh2z3o Jul 06 12:33:26 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:27 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81643be6-d7d0-4b79-8d52-bdcd230e5133_nejh2z3o" returned: 1 in 0.751s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81643be6-d7d0-4b79-8d52-bdcd230e5133_nejh2z3o' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:33:27 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a2d461-4a19-430f-9d4e-12deb12209a0]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:27 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD Jul 06 12:33:27 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:28 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD" returned: 0 in 0.782s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:28 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD Jul 06 12:33:28 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:28 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD" returned: 1 in 0.719s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:33:29 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] 81643be6-d7d0-4b79-8d52-bdcd230e5133 was raw, converting to raw {{(pid=86761) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:33:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:29 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 Jul 06 12:33:29 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:29 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2" returned: 0 in 0.804s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:29 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_81643be6-d7d0-4b79-8d52-bdcd230e5133_edm16s9qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:33:29 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 12:33:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:29 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 1G Jul 06 12:33:29 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:30 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 1G" returned: 0 in 0.726s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:30 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f661ca4b-ec6a-4da0-b5f3-0f7517f348aa]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:30 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 Jul 06 12:33:30 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:31 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2" returned: 0 in 0.859s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:31 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 Jul 06 12:33:31 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:32 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2" returned: 1 in 0.775s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:33:32 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Downloaded image 81643be6-d7d0-4b79-8d52-bdcd230e5133 ((None, [{'url': 'file:///opt/stack/data/glance/images/81643be6-d7d0-4b79-8d52-bdcd230e5133', 'metadata': {}}])) to volume 05e3f32a-7c6c-4310-b395-3103edb813c2 successfully. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:33:32 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Temporary image 81643be6-d7d0-4b79-8d52-bdcd230e5133 for user ca54d2feadff467b9530378f806f09e4 is deleted. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:33:32 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Marking volume 05e3f32a-7c6c-4310-b395-3103edb813c2 as bootable. {{(pid=86761) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:33:32 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Copying metadata from image 81643be6-d7d0-4b79-8d52-bdcd230e5133 to 05e3f32a-7c6c-4310-b395-3103edb813c2. {{(pid=86761) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:33:32 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Creating volume glance metadata for volume 05e3f32a-7c6c-4310-b395-3103edb813c2 backed by image 81643be6-d7d0-4b79-8d52-bdcd230e5133 with: {'image_id': '81643be6-d7d0-4b79-8d52-bdcd230e5133', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5671615fdb3fcb14aa41c69e6bf8c76e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86761) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:33:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349df080-e60f-43d1-afd5-8c739d8adf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e3f32a-7c6c-4310-b395-3103edb813c2', 'volume_size': 1, 'image_id': '81643be6-d7d0-4b79-8d52-bdcd230e5133', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81643be6-d7d0-4b79-8d52-bdcd230e5133', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5671615fdb3fcb14aa41c69e6bf8c76e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df69056720da424d9fd58aa2dfc1d100', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '57a63419bfecb4c702bf291a236df8ae17340aca96a7ab6f304065c7c206f045d6130f040377487013fcbabb6007d6ac4083b121fe53c37ebe99b2f503ae5c7b', 'id': '81643be6-d7d0-4b79-8d52-bdcd230e5133', 'created_at': datetime.datetime(2026, 7, 6, 10, 33, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 33, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81643be6-d7d0-4b79-8d52-bdcd230e5133/file', 'properties': {}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26543935-ff44-41bd-ad6d-fb72409f2065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:32 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Volume volume-05e3f32a-7c6c-4310-b395-3103edb813c2 (05e3f32a-7c6c-4310-b395-3103edb813c2): created successfully Jul 06 12:33:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26543935-ff44-41bd-ad6d-fb72409f2065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Flow 'volume_create_manager' (40580909-f781-4203-9817-bf9359bae9a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:32 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b250ab47-bca5-4992-85d2-269457677592 tempest-VolumeImageDependencyTests-2014064361 None] Created volume successfully. Jul 06 12:33:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Acquiring lock "cinder-05e3f32a-7c6c-4310-b395-3103edb813c2-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Lock "cinder-05e3f32a-7c6c-4310-b395-3103edb813c2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Acquiring lock "cinder-quobyte-05e3f32a-7c6c-4310-b395-3103edb813c2" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Lock "cinder-quobyte-05e3f32a-7c6c-4310-b395-3103edb813c2" acquired by "delete_volume" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:33 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[206c0309-6fd3-4283-9500-362de333b1b0]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:33 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 Jul 06 12:33:33 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:34 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2" returned: 0 in 0.803s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:34 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 Jul 06 12:33:34 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:35 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2" returned: 1 in 0.793s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:33:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:35 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2 Jul 06 12:33:35 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:35 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-05e3f32a-7c6c-4310-b395-3103edb813c2" returned: 0 in 0.660s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Lock "cinder-quobyte-05e3f32a-7c6c-4310-b395-3103edb813c2" released by "delete_volume" :: held 2.321s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:35 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Created reservations ['3b371664-079d-4064-b610-59c16dfb076e', '8c84ef1c-ed23-4d5c-b672-6273e5df05d4', 'd5e358a5-00dc-4c1d-a6a5-1cff7a41ca25', '9d11c97d-6487-4825-a77c-208823a93d8e'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:36 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:33:36 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:36 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.643s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:36 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:33:36 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Deleted volume successfully. Jul 06 12:33:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-34dee283-5d04-4c42-86fb-b94fa1de4f38 tempest-VolumeImageDependencyTests-2014064361 None] Lock "cinder-05e3f32a-7c6c-4310-b395-3103edb813c2-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Flow 'volume_create_manager' (d35830e7-1e34-44f8-a42f-c9f5a5789f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a49cef-b505-4d51-aff9-4e6e6067080c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a49cef-b505-4d51-aff9-4e6e6067080c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-576465536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4774169b-169b-4ca1-8db6-da0cbd8288be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80839d517ada4befa677d461a99c81c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:40Z,use_quota=True,user_id='d41c2c56245c4a239f9a9a804c7ee17a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeea2cce-3711-4c8d-9130-61c6ab6e4c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeea2cce-3711-4c8d-9130-61c6ab6e4c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61e6a89-e0f9-4e28-bfed-7503255a355c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61e6a89-e0f9-4e28-bfed-7503255a355c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4774169b-169b-4ca1-8db6-da0cbd8288be', 'volume_name': 'volume-4774169b-169b-4ca1-8db6-da0cbd8288be', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80562b10-9893-45bb-b5c4-5dc5870364bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80562b10-9893-45bb-b5c4-5dc5870364bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f137fa98-3c0f-46e4-a4e2-0faea94b99f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:40 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Volume 4774169b-169b-4ca1-8db6-da0cbd8288be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4774169b-169b-4ca1-8db6-da0cbd8288be', 'volume_size': 1} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-576465536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4774169b-169b-4ca1-8db6-da0cbd8288be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80839d517ada4befa677d461a99c81c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:40Z,use_quota=True,user_id='d41c2c56245c4a239f9a9a804c7ee17a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Creating volume 4774169b-169b-4ca1-8db6-da0cbd8288be {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:33:40 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:33:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4774169b-169b-4ca1-8db6-da0cbd8288be 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:40 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4774169b-169b-4ca1-8db6-da0cbd8288be 1073741824 Jul 06 12:33:40 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:41 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4774169b-169b-4ca1-8db6-da0cbd8288be 1073741824" returned: 0 in 0.939s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4774169b-169b-4ca1-8db6-da0cbd8288be {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:41 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4774169b-169b-4ca1-8db6-da0cbd8288be Jul 06 12:33:41 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:42 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4774169b-169b-4ca1-8db6-da0cbd8288be" returned: 0 in 0.645s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:33:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f137fa98-3c0f-46e4-a4e2-0faea94b99f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4774169b-169b-4ca1-8db6-da0cbd8288be', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d16708-05e0-448c-9ff8-56022f56315a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:42 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Volume volume-4774169b-169b-4ca1-8db6-da0cbd8288be (4774169b-169b-4ca1-8db6-da0cbd8288be): created successfully Jul 06 12:33:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d16708-05e0-448c-9ff8-56022f56315a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Flow 'volume_create_manager' (d35830e7-1e34-44f8-a42f-c9f5a5789f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:42 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0b4f6736-cbc9-4585-ae5e-242c0fddcf9b tempest-ProjectReaderTests-1037169847 None] Created volume successfully. Jul 06 12:33:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Acquiring lock "cinder-4774169b-169b-4ca1-8db6-da0cbd8288be-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Lock "cinder-4774169b-169b-4ca1-8db6-da0cbd8288be-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Acquiring lock "cinder-quobyte-4774169b-169b-4ca1-8db6-da0cbd8288be" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Lock "cinder-quobyte-4774169b-169b-4ca1-8db6-da0cbd8288be" acquired by "delete_volume" :: waited 0.014s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:42 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fdbcf8-4f03-4937-ae5f-08828bbf5235]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4774169b-169b-4ca1-8db6-da0cbd8288be {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:42 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4774169b-169b-4ca1-8db6-da0cbd8288be Jul 06 12:33:42 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:43 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4774169b-169b-4ca1-8db6-da0cbd8288be" returned: 0 in 0.735s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4774169b-169b-4ca1-8db6-da0cbd8288be {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:43 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4774169b-169b-4ca1-8db6-da0cbd8288be Jul 06 12:33:43 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:44 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4774169b-169b-4ca1-8db6-da0cbd8288be" returned: 0 in 0.680s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Lock "cinder-quobyte-4774169b-169b-4ca1-8db6-da0cbd8288be" released by "delete_volume" :: held 1.450s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:44 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Created reservations ['5ef1cbf1-a375-483f-a37b-fa0032631bd5', 'c679ca00-2fb8-454a-8e9a-d0fe93fdfde0', '682d8b93-f46e-4a3d-9759-e1163ac97be2', 'ad509485-ebb9-4974-b6ba-1405e1d1261e'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:44 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:44 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:44 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:33:44 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:44 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.684s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:44 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:33:44 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Deleted volume successfully. Jul 06 12:33:44 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c9f0a08-0a28-4d66-820f-dda619381a52 tempest-ProjectReaderTests-1037169847 None] Lock "cinder-4774169b-169b-4ca1-8db6-da0cbd8288be-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Flow 'volume_create_manager' (fec093fb-9d92-4946-aeca-d57120972b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d390ba89-6796-4355-aa29-439b842b98d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d390ba89-6796-4355-aa29-439b842b98d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1197939285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a17c0d1-c15f-4601-abc5-abb5a2ea0564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80839d517ada4befa677d461a99c81c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:45Z,use_quota=True,user_id='d41c2c56245c4a239f9a9a804c7ee17a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c771a55-1a38-498d-a764-f79c0bfcf341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c771a55-1a38-498d-a764-f79c0bfcf341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09129ae7-bcfc-4e6b-918c-fc842f490fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09129ae7-bcfc-4e6b-918c-fc842f490fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a17c0d1-c15f-4601-abc5-abb5a2ea0564', 'volume_name': 'volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da919d2e-5760-4d8c-b94f-b6b2fda635e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da919d2e-5760-4d8c-b94f-b6b2fda635e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1856d198-c467-4f43-b60d-4a6eae8f1a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:45 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Volume 9a17c0d1-c15f-4601-abc5-abb5a2ea0564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564', 'volume_size': 1} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1197939285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a17c0d1-c15f-4601-abc5-abb5a2ea0564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80839d517ada4befa677d461a99c81c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:45Z,use_quota=True,user_id='d41c2c56245c4a239f9a9a804c7ee17a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Creating volume 9a17c0d1-c15f-4601-abc5-abb5a2ea0564 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:33:45 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:33:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:45 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564 1073741824 Jul 06 12:33:45 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:46 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564 1073741824" returned: 0 in 0.907s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:46 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564 Jul 06 12:33:46 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:47 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564" returned: 0 in 0.689s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:33:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1856d198-c467-4f43-b60d-4a6eae8f1a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df29b80-2c76-4461-a0c0-9e351ccfe118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:47 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Volume volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564 (9a17c0d1-c15f-4601-abc5-abb5a2ea0564): created successfully Jul 06 12:33:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df29b80-2c76-4461-a0c0-9e351ccfe118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Flow 'volume_create_manager' (fec093fb-9d92-4946-aeca-d57120972b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:47 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a9baed6d-30ff-4521-8ea2-92f34cc53145 tempest-ProjectReaderTests-1037169847 None] Created volume successfully. Jul 06 12:33:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Acquiring lock "cinder-9a17c0d1-c15f-4601-abc5-abb5a2ea0564-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Lock "cinder-9a17c0d1-c15f-4601-abc5-abb5a2ea0564-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Acquiring lock "cinder-quobyte-9a17c0d1-c15f-4601-abc5-abb5a2ea0564" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Lock "cinder-quobyte-9a17c0d1-c15f-4601-abc5-abb5a2ea0564" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:47 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5b9a66-4f9f-416e-9259-bc6d94ff558c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:47 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564 Jul 06 12:33:47 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:48 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564" returned: 0 in 0.796s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:48 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564 Jul 06 12:33:48 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:49 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9a17c0d1-c15f-4601-abc5-abb5a2ea0564" returned: 0 in 0.684s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Lock "cinder-quobyte-9a17c0d1-c15f-4601-abc5-abb5a2ea0564" released by "delete_volume" :: held 1.521s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:49 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Created reservations ['36a33193-94ed-4db7-84e4-2e3df42ca196', 'fdd4a1c4-a138-4d23-aebe-c466324bd092', '0ef95cc1-dc55-49c8-ab9d-b47311bc2aff', 'ccca3ee4-ee44-4dbb-9f4e-9701c885194b'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:49 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:33:49 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:49 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.767s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:49 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:33:49 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Deleted volume successfully. Jul 06 12:33:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bcc436a5-9c8c-4b01-a7bd-ef77e46711aa tempest-ProjectReaderTests-1037169847 None] Lock "cinder-9a17c0d1-c15f-4601-abc5-abb5a2ea0564-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:33:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:52 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:33:52 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:53 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.747s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Flow 'volume_create_manager' (902dd8c2-cf73-425c-83ec-04f38fc668dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24289ce6-ca75-490a-a02c-a9d128adbdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24289ce6-ca75-490a-a02c-a9d128adbdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672150269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3510325-db49-4924-a6bd-45dc77462b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88f0ab9bc4141f992e5ba1da1a603dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:54Z,use_quota=True,user_id='4040becd48c54131bbe94d86dfdef6a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df67dd6e-349c-40b2-8b7d-57d0c929de12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df67dd6e-349c-40b2-8b7d-57d0c929de12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0997e06-c8b3-4fea-b377-732d7ffd8a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0997e06-c8b3-4fea-b377-732d7ffd8a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3510325-db49-4924-a6bd-45dc77462b79', 'volume_name': 'volume-c3510325-db49-4924-a6bd-45dc77462b79', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d16d3787-93fe-469c-9d87-5d0a42864c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d16d3787-93fe-469c-9d87-5d0a42864c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1054e945-4c27-4e5d-b134-c842f66b671a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:53 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Volume c3510325-db49-4924-a6bd-45dc77462b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3510325-db49-4924-a6bd-45dc77462b79', 'volume_size': 1} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672150269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3510325-db49-4924-a6bd-45dc77462b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88f0ab9bc4141f992e5ba1da1a603dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:54Z,use_quota=True,user_id='4040becd48c54131bbe94d86dfdef6a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Creating volume c3510325-db49-4924-a6bd-45dc77462b79 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:33:53 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:33:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c3510325-db49-4924-a6bd-45dc77462b79 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:53 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c3510325-db49-4924-a6bd-45dc77462b79 1073741824 Jul 06 12:33:53 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:54 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c3510325-db49-4924-a6bd-45dc77462b79 1073741824" returned: 0 in 0.910s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c3510325-db49-4924-a6bd-45dc77462b79 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:54 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c3510325-db49-4924-a6bd-45dc77462b79 Jul 06 12:33:54 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:55 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c3510325-db49-4924-a6bd-45dc77462b79" returned: 0 in 0.689s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:33:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1054e945-4c27-4e5d-b134-c842f66b671a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3510325-db49-4924-a6bd-45dc77462b79', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35777bff-2323-47bb-8897-3112e57df28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:55 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Volume volume-c3510325-db49-4924-a6bd-45dc77462b79 (c3510325-db49-4924-a6bd-45dc77462b79): created successfully Jul 06 12:33:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35777bff-2323-47bb-8897-3112e57df28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:55 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Flow 'volume_create_manager' (902dd8c2-cf73-425c-83ec-04f38fc668dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:55 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f2ad244e-15b3-4eb6-a0e0-6b42404e5f27 tempest-ProjectReaderTests-1069890820 None] Created volume successfully. Jul 06 12:33:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Acquiring lock "cinder-c3510325-db49-4924-a6bd-45dc77462b79-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Lock "cinder-c3510325-db49-4924-a6bd-45dc77462b79-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Acquiring lock "cinder-quobyte-c3510325-db49-4924-a6bd-45dc77462b79" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:56 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Lock "cinder-quobyte-c3510325-db49-4924-a6bd-45dc77462b79" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:56 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3ec949-a009-45cf-be0b-313a2d779510]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c3510325-db49-4924-a6bd-45dc77462b79 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:56 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c3510325-db49-4924-a6bd-45dc77462b79 Jul 06 12:33:56 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:56 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c3510325-db49-4924-a6bd-45dc77462b79" returned: 0 in 0.793s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c3510325-db49-4924-a6bd-45dc77462b79 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:56 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c3510325-db49-4924-a6bd-45dc77462b79 Jul 06 12:33:56 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:57 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c3510325-db49-4924-a6bd-45dc77462b79" returned: 0 in 0.697s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Lock "cinder-quobyte-c3510325-db49-4924-a6bd-45dc77462b79" released by "delete_volume" :: held 1.535s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:57 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Created reservations ['5f817968-316b-4f42-8695-c449b6cff6a1', '3749f2a0-a064-44fb-8003-ba009e124d15', '32d05064-9c71-4667-bef0-318dac6fd15c', '1d7b6302-ec36-46db-8c33-bef9f8b7b6d0'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:57 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:33:57 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:58 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.685s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:33:58 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Deleted volume successfully. Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-594fc24b-afc5-479a-8128-ab92207bfac1 tempest-ProjectReaderTests-1069890820 None] Lock "cinder-c3510325-db49-4924-a6bd-45dc77462b79-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Flow 'volume_create_manager' (56ebf614-6c7d-4d2b-a406-f2b6629539b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c111a5c-9f55-47ca-a17f-8c2ee5e7569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c111a5c-9f55-47ca-a17f-8c2ee5e7569e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1546548804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c8fcda-7b49-434d-811e-7ea1ac33675f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88f0ab9bc4141f992e5ba1da1a603dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:59Z,use_quota=True,user_id='4040becd48c54131bbe94d86dfdef6a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3aa9e7-3123-4b83-ae20-657708e034fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3aa9e7-3123-4b83-ae20-657708e034fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20a8571-b44c-485c-85b8-eeed66ab5040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20a8571-b44c-485c-85b8-eeed66ab5040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62c8fcda-7b49-434d-811e-7ea1ac33675f', 'volume_name': 'volume-62c8fcda-7b49-434d-811e-7ea1ac33675f', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c49f9b9-1ea1-45fd-b76b-8d8f1d26cf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c49f9b9-1ea1-45fd-b76b-8d8f1d26cf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8c0f9e-520d-4a5a-87fa-c79e3eb555e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:58 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Volume 62c8fcda-7b49-434d-811e-7ea1ac33675f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62c8fcda-7b49-434d-811e-7ea1ac33675f', 'volume_size': 1} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1546548804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c8fcda-7b49-434d-811e-7ea1ac33675f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88f0ab9bc4141f992e5ba1da1a603dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:59Z,use_quota=True,user_id='4040becd48c54131bbe94d86dfdef6a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Creating volume 62c8fcda-7b49-434d-811e-7ea1ac33675f {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:33:58 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:33:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-62c8fcda-7b49-434d-811e-7ea1ac33675f 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:58 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-62c8fcda-7b49-434d-811e-7ea1ac33675f 1073741824 Jul 06 12:33:58 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:59 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-62c8fcda-7b49-434d-811e-7ea1ac33675f 1073741824" returned: 0 in 0.871s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-62c8fcda-7b49-434d-811e-7ea1ac33675f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:59 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-62c8fcda-7b49-434d-811e-7ea1ac33675f Jul 06 12:33:59 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:00 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-62c8fcda-7b49-434d-811e-7ea1ac33675f" returned: 0 in 0.656s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8c0f9e-520d-4a5a-87fa-c79e3eb555e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62c8fcda-7b49-434d-811e-7ea1ac33675f', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef4b109-a7be-4f66-b183-4580f1565867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:00 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Volume volume-62c8fcda-7b49-434d-811e-7ea1ac33675f (62c8fcda-7b49-434d-811e-7ea1ac33675f): created successfully Jul 06 12:34:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef4b109-a7be-4f66-b183-4580f1565867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Flow 'volume_create_manager' (56ebf614-6c7d-4d2b-a406-f2b6629539b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:00 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6c8d9e66-2aac-4fe8-92de-a61f27ac041d tempest-ProjectReaderTests-1069890820 None] Created volume successfully. Jul 06 12:34:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Acquiring lock "cinder-62c8fcda-7b49-434d-811e-7ea1ac33675f-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Lock "cinder-62c8fcda-7b49-434d-811e-7ea1ac33675f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Acquiring lock "cinder-quobyte-62c8fcda-7b49-434d-811e-7ea1ac33675f" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Lock "cinder-quobyte-62c8fcda-7b49-434d-811e-7ea1ac33675f" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:00 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3de224-c072-4b36-996c-a1a53f8eea33]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-62c8fcda-7b49-434d-811e-7ea1ac33675f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:01 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-62c8fcda-7b49-434d-811e-7ea1ac33675f Jul 06 12:34:01 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:01 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-62c8fcda-7b49-434d-811e-7ea1ac33675f" returned: 0 in 0.761s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-62c8fcda-7b49-434d-811e-7ea1ac33675f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:01 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-62c8fcda-7b49-434d-811e-7ea1ac33675f Jul 06 12:34:01 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:02 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-62c8fcda-7b49-434d-811e-7ea1ac33675f" returned: 0 in 0.654s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Lock "cinder-quobyte-62c8fcda-7b49-434d-811e-7ea1ac33675f" released by "delete_volume" :: held 1.454s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:02 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Created reservations ['ceaab9ef-27ce-49b6-be00-c1aaddfa6356', '105e0247-a738-4a08-b6f0-72f9e49f8fac', '462211cf-7913-442b-a968-5ba144d0540b', '0c5bb912-7414-4429-897e-659af4e0bc64'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:02 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:02 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:02 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:34:02 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:03 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.708s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:03 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Deleted volume successfully. Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4471049e-452b-495a-a02d-84857dee2c5f tempest-ProjectReaderTests-1069890820 None] Lock "cinder-62c8fcda-7b49-434d-811e-7ea1ac33675f-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Flow 'volume_create_manager' (0f118110-95a4-47ff-9ac0-f37a772be1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fce22f2-977d-4ce9-87f9-a80a6dfb274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fce22f2-977d-4ce9-87f9-a80a6dfb274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1052010839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c8fdad-483c-4c3d-94bb-92344c1366b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88f0ab9bc4141f992e5ba1da1a603dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:03Z,use_quota=True,user_id='4040becd48c54131bbe94d86dfdef6a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a024ce6-c5eb-4fa1-8cd4-2b49e6035321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a024ce6-c5eb-4fa1-8cd4-2b49e6035321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290cdb81-51bb-4da0-b447-5a0eb9c471a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290cdb81-51bb-4da0-b447-5a0eb9c471a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c8fdad-483c-4c3d-94bb-92344c1366b6', 'volume_name': 'volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a1c6bf-f3a0-4d49-b758-0a09002e9b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a1c6bf-f3a0-4d49-b758-0a09002e9b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6782e600-97e4-4a99-aaa2-b98f05f5fbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:03 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Volume e3c8fdad-483c-4c3d-94bb-92344c1366b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6', 'volume_size': 1} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1052010839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c8fdad-483c-4c3d-94bb-92344c1366b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88f0ab9bc4141f992e5ba1da1a603dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:03Z,use_quota=True,user_id='4040becd48c54131bbe94d86dfdef6a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Creating volume e3c8fdad-483c-4c3d-94bb-92344c1366b6 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:03 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:34:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:03 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6 1073741824 Jul 06 12:34:03 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:04 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6 1073741824" returned: 0 in 0.836s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:04 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6 Jul 06 12:34:04 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:05 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6" returned: 0 in 0.654s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:05 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6782e600-97e4-4a99-aaa2-b98f05f5fbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:05 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cd061c-1241-4ea6-b5c1-763f89d0bf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:05 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Volume volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6 (e3c8fdad-483c-4c3d-94bb-92344c1366b6): created successfully Jul 06 12:34:05 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cd061c-1241-4ea6-b5c1-763f89d0bf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:05 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Flow 'volume_create_manager' (0f118110-95a4-47ff-9ac0-f37a772be1e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:05 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-32a502a8-1571-4359-b38b-67aea0be97eb tempest-ProjectReaderTests-1069890820 None] Created volume successfully. Jul 06 12:34:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Acquiring lock "cinder-e3c8fdad-483c-4c3d-94bb-92344c1366b6-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Lock "cinder-e3c8fdad-483c-4c3d-94bb-92344c1366b6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Acquiring lock "cinder-quobyte-e3c8fdad-483c-4c3d-94bb-92344c1366b6" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Lock "cinder-quobyte-e3c8fdad-483c-4c3d-94bb-92344c1366b6" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:05 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d7f76a-19af-471c-8ba4-904294f3a374]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:05 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6 Jul 06 12:34:05 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:06 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6" returned: 0 in 0.764s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:06 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6 Jul 06 12:34:06 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:07 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e3c8fdad-483c-4c3d-94bb-92344c1366b6" returned: 0 in 0.676s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Lock "cinder-quobyte-e3c8fdad-483c-4c3d-94bb-92344c1366b6" released by "delete_volume" :: held 1.480s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:07 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Created reservations ['6ec4d43a-c9d0-4beb-b759-340d3b332eac', '49c1ab81-4ce4-4c16-ac53-1fd25ac16985', '15718fd7-9294-45db-a7e3-f0de79b3c59a', '46d328e3-ceec-4260-89f9-26e2cd0608fe'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:07 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:34:07 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:08 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.714s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:08 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Deleted volume successfully. Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-604a4e5a-f956-4497-95b8-bd692011e7de tempest-ProjectReaderTests-1069890820 None] Lock "cinder-e3c8fdad-483c-4c3d-94bb-92344c1366b6-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Flow 'volume_create_manager' (e57b553d-8487-4ee3-a94b-58631bb44e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb71e7d-5ca3-4041-97b0-ed116816583f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb71e7d-5ca3-4041-97b0-ed116816583f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591054530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fd1ac9-eb44-4586-b11b-f2fb02582473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88f0ab9bc4141f992e5ba1da1a603dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:08Z,use_quota=True,user_id='4040becd48c54131bbe94d86dfdef6a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba1e337-8b79-406c-aee6-9a999de7c3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba1e337-8b79-406c-aee6-9a999de7c3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827ad4cd-6f9b-4fc9-b6fc-286385701ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827ad4cd-6f9b-4fc9-b6fc-286385701ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08fd1ac9-eb44-4586-b11b-f2fb02582473', 'volume_name': 'volume-08fd1ac9-eb44-4586-b11b-f2fb02582473', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa6774b-e72e-413b-8c99-9ee516a9411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa6774b-e72e-413b-8c99-9ee516a9411f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc0374e-ef00-442c-8e05-eab7cebf1d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:08 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Volume 08fd1ac9-eb44-4586-b11b-f2fb02582473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08fd1ac9-eb44-4586-b11b-f2fb02582473', 'volume_size': 1} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591054530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fd1ac9-eb44-4586-b11b-f2fb02582473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88f0ab9bc4141f992e5ba1da1a603dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:08Z,use_quota=True,user_id='4040becd48c54131bbe94d86dfdef6a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Creating volume 08fd1ac9-eb44-4586-b11b-f2fb02582473 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:08 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:34:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-08fd1ac9-eb44-4586-b11b-f2fb02582473 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:08 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-08fd1ac9-eb44-4586-b11b-f2fb02582473 1073741824 Jul 06 12:34:08 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:09 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-08fd1ac9-eb44-4586-b11b-f2fb02582473 1073741824" returned: 0 in 0.888s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-08fd1ac9-eb44-4586-b11b-f2fb02582473 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:09 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-08fd1ac9-eb44-4586-b11b-f2fb02582473 Jul 06 12:34:09 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:10 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-08fd1ac9-eb44-4586-b11b-f2fb02582473" returned: 0 in 0.679s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc0374e-ef00-442c-8e05-eab7cebf1d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08fd1ac9-eb44-4586-b11b-f2fb02582473', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dee95ce-512d-4f7e-bff5-2481912c8325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:10 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Volume volume-08fd1ac9-eb44-4586-b11b-f2fb02582473 (08fd1ac9-eb44-4586-b11b-f2fb02582473): created successfully Jul 06 12:34:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dee95ce-512d-4f7e-bff5-2481912c8325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Flow 'volume_create_manager' (e57b553d-8487-4ee3-a94b-58631bb44e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:10 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d7b145ef-8e70-4646-ba1a-24bd73bf25fd tempest-ProjectReaderTests-1069890820 None] Created volume successfully. Jul 06 12:34:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Acquiring lock "cinder-08fd1ac9-eb44-4586-b11b-f2fb02582473-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Lock "cinder-08fd1ac9-eb44-4586-b11b-f2fb02582473-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Acquiring lock "cinder-quobyte-08fd1ac9-eb44-4586-b11b-f2fb02582473" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Lock "cinder-quobyte-08fd1ac9-eb44-4586-b11b-f2fb02582473" acquired by "delete_volume" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:10 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5339f3d-b362-4d29-a5d7-3784914f635b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-08fd1ac9-eb44-4586-b11b-f2fb02582473 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:10 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-08fd1ac9-eb44-4586-b11b-f2fb02582473 Jul 06 12:34:10 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:11 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-08fd1ac9-eb44-4586-b11b-f2fb02582473" returned: 0 in 0.784s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-08fd1ac9-eb44-4586-b11b-f2fb02582473 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:11 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-08fd1ac9-eb44-4586-b11b-f2fb02582473 Jul 06 12:34:11 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:12 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-08fd1ac9-eb44-4586-b11b-f2fb02582473" returned: 0 in 0.656s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Lock "cinder-quobyte-08fd1ac9-eb44-4586-b11b-f2fb02582473" released by "delete_volume" :: held 1.487s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:12 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Created reservations ['14dabcac-ecc5-45b0-b39a-9af7eb52b4b2', '38cea144-737b-4907-b772-d53d3db1c5a2', 'fcefd5f8-f1c9-4bfe-bb38-643cc3755b9e', '92b7c353-c27e-4c31-ab70-683c5b4f6bb4'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:12 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:34:12 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:12 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.697s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:12 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:12 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Deleted volume successfully. Jul 06 12:34:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-852d3a9d-a7b4-43d8-a75e-4dfe6cb271ec tempest-ProjectReaderTests-1069890820 None] Lock "cinder-08fd1ac9-eb44-4586-b11b-f2fb02582473-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:22 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:INSERT=24,cinder:SELECT=49,cinder:UPDATE=76,cinder:DELETE=8 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:34:22 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=60,cinder:UPDATE=81,cinder:INSERT=20,cinder:DELETE=6 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Flow 'volume_create_manager' (8065e343-9266-4e4d-8817-45b1e5a0e0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b71b65-78c0-4c49-b550-31dbaded4871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b71b65-78c0-4c49-b550-31dbaded4871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1635614630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca3152d-44d1-487a-ad9b-0cc661d534da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4462ca779446ed9cc70ebce9cf208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:25Z,use_quota=True,user_id='882ef555b762457dbe8c58ee54d76624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2a23be-46fa-423e-937f-940e67997a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2a23be-46fa-423e-937f-940e67997a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4da0c0d-ed64-48cd-9987-494b145aa35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4da0c0d-ed64-48cd-9987-494b145aa35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aca3152d-44d1-487a-ad9b-0cc661d534da', 'volume_name': 'volume-aca3152d-44d1-487a-ad9b-0cc661d534da', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff906494-04aa-4dab-b616-797ce766f64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff906494-04aa-4dab-b616-797ce766f64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5cea78-df5a-4d9e-a409-49f9fe7d83d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:25 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Volume aca3152d-44d1-487a-ad9b-0cc661d534da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aca3152d-44d1-487a-ad9b-0cc661d534da', 'volume_size': 1} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1635614630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca3152d-44d1-487a-ad9b-0cc661d534da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4462ca779446ed9cc70ebce9cf208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:25Z,use_quota=True,user_id='882ef555b762457dbe8c58ee54d76624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Creating volume aca3152d-44d1-487a-ad9b-0cc661d534da {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:25 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aca3152d-44d1-487a-ad9b-0cc661d534da 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:25 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aca3152d-44d1-487a-ad9b-0cc661d534da 1073741824 Jul 06 12:34:25 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Flow 'volume_create_manager' (44f62801-6553-4879-98a3-26574473a0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65089000-81ec-491a-bd07-ceaf054258a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65089000-81ec-491a-bd07-ceaf054258a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1470046129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c6c9a8-a579-4e23-8bb2-8ebbddce6430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d264df2a1b2447984d59ddb0adc87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:25Z,use_quota=True,user_id='df9adc2baa4e406d9d0df067e8c8dcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96166d1-63e6-4121-a69d-01252b362177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96166d1-63e6-4121-a69d-01252b362177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a48502-f697-4c6b-b9bf-d174da5edf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a48502-f697-4c6b-b9bf-d174da5edf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c6c9a8-a579-4e23-8bb2-8ebbddce6430', 'volume_name': 'volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c0cec8-b550-40f5-a3ff-bc6b76dc7e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c0cec8-b550-40f5-a3ff-bc6b76dc7e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cf2e73-7bc4-4f9a-9fdd-ab9ae2642356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:25 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume 90c6c9a8-a579-4e23-8bb2-8ebbddce6430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430', 'volume_size': 1} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Flow 'volume_create_manager' (51da664f-8114-48a2-bdbf-b3c5ede28301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c7b0c6-8d65-4103-89bf-7909a037d10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c7b0c6-8d65-4103-89bf-7909a037d10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1910496049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d18958-bce9-4d98-91d5-d110e6e500df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4462ca779446ed9cc70ebce9cf208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:25Z,use_quota=True,user_id='882ef555b762457dbe8c58ee54d76624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6e9805-f179-4d92-b56f-770c72aaf87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6e9805-f179-4d92-b56f-770c72aaf87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2485b948-02e5-44a0-9283-2c695907ea11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2485b948-02e5-44a0-9283-2c695907ea11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d18958-bce9-4d98-91d5-d110e6e500df', 'volume_name': 'volume-76d18958-bce9-4d98-91d5-d110e6e500df', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd506903-92b4-4d5a-8c14-5fdbdfe194e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd506903-92b4-4d5a-8c14-5fdbdfe194e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9485b3e-8357-4847-a4a5-87a5291521fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:25 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Volume 76d18958-bce9-4d98-91d5-d110e6e500df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d18958-bce9-4d98-91d5-d110e6e500df', 'volume_size': 1} Jul 06 12:34:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Flow 'volume_create_manager' (833e8bd1-3075-482e-9feb-e12ed19fd428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4014b805-5870-4ac8-adf4-81180a71541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4014b805-5870-4ac8-adf4-81180a71541a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-608998856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445c5989-020f-46ad-9c46-d7fc07fabe6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4462ca779446ed9cc70ebce9cf208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:26Z,use_quota=True,user_id='882ef555b762457dbe8c58ee54d76624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4bf334d-9abb-4f0e-9af5-a21387436c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4bf334d-9abb-4f0e-9af5-a21387436c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473b4088-aaa5-43e5-824a-0a5d233627d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473b4088-aaa5-43e5-824a-0a5d233627d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '445c5989-020f-46ad-9c46-d7fc07fabe6d', 'volume_name': 'volume-445c5989-020f-46ad-9c46-d7fc07fabe6d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef61d79-2294-455e-8daf-7ff9feda1a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef61d79-2294-455e-8daf-7ff9feda1a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83de9c55-70ac-425e-9c7c-f573eadcf4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:26 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Volume 445c5989-020f-46ad-9c46-d7fc07fabe6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-445c5989-020f-46ad-9c46-d7fc07fabe6d', 'volume_size': 1} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:26 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aca3152d-44d1-487a-ad9b-0cc661d534da 1073741824" returned: 0 in 1.246s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aca3152d-44d1-487a-ad9b-0cc661d534da {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Flow 'volume_create_manager' (af49f333-0509-4d66-95be-d2b2ccbf5490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:26 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aca3152d-44d1-487a-ad9b-0cc661d534da Jul 06 12:34:26 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c33df7-2a18-4a7c-963e-7776762fbacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c33df7-2a18-4a7c-963e-7776762fbacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1114207373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8e1915-b958-4019-a757-98c3ea23e785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4462ca779446ed9cc70ebce9cf208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:26Z,use_quota=True,user_id='882ef555b762457dbe8c58ee54d76624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceed1ade-40d6-47ae-b474-f75a4e0c852e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceed1ade-40d6-47ae-b474-f75a4e0c852e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc78dfac-3af0-4d81-948d-89fdd5c05245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc78dfac-3af0-4d81-948d-89fdd5c05245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8e1915-b958-4019-a757-98c3ea23e785', 'volume_name': 'volume-2e8e1915-b958-4019-a757-98c3ea23e785', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0036c9c5-727d-4e22-aced-e275a5fc7a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0036c9c5-727d-4e22-aced-e275a5fc7a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2645f69f-9d9d-4da7-b3d0-20e68bf46694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:26 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Volume 2e8e1915-b958-4019-a757-98c3ea23e785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8e1915-b958-4019-a757-98c3ea23e785', 'volume_size': 1} Jul 06 12:34:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Flow 'volume_create_manager' (1254e5a7-c354-4b6e-95d4-8fbb1badf6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ea7077-fc74-4c6a-b212-e4adea1b99e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ea7077-fc74-4c6a-b212-e4adea1b99e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1614822633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ed44d7-901c-443a-b64e-098baf6fa21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4462ca779446ed9cc70ebce9cf208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:27Z,use_quota=True,user_id='882ef555b762457dbe8c58ee54d76624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4116615b-2e3f-4894-9d39-3938835b351c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4116615b-2e3f-4894-9d39-3938835b351c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5649d786-1f6b-4902-9b28-4614613f2897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5649d786-1f6b-4902-9b28-4614613f2897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84ed44d7-901c-443a-b64e-098baf6fa21f', 'volume_name': 'volume-84ed44d7-901c-443a-b64e-098baf6fa21f', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b386485f-6617-475a-a32d-c0825d60ae79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b386485f-6617-475a-a32d-c0825d60ae79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac3f6c1-dc76-4b96-9933-663beed605c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:27 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Volume 84ed44d7-901c-443a-b64e-098baf6fa21f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84ed44d7-901c-443a-b64e-098baf6fa21f', 'volume_size': 1} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:27 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aca3152d-44d1-487a-ad9b-0cc661d534da" returned: 0 in 0.797s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] <== create_volume: return (2186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.189s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.697s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1470046129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c6c9a8-a579-4e23-8bb2-8ebbddce6430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d264df2a1b2447984d59ddb0adc87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:25Z,use_quota=True,user_id='df9adc2baa4e406d9d0df067e8c8dcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Creating volume 90c6c9a8-a579-4e23-8bb2-8ebbddce6430 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:27 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:27 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430 1073741824 Jul 06 12:34:27 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5cea78-df5a-4d9e-a409-49f9fe7d83d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aca3152d-44d1-487a-ad9b-0cc661d534da', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939ec58b-d90c-4fee-91c9-920dd6f32fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:27 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Volume volume-aca3152d-44d1-487a-ad9b-0cc661d534da (aca3152d-44d1-487a-ad9b-0cc661d534da): created successfully Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939ec58b-d90c-4fee-91c9-920dd6f32fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Flow 'volume_create_manager' (8065e343-9266-4e4d-8817-45b1e5a0e0ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:27 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7875ab11-6383-4f63-9906-0a4a4687184d tempest-CreateVolumesFromImageTest-1151308564 None] Created volume successfully. Jul 06 12:34:28 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430 1073741824" returned: 0 in 1.014s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:28 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430 Jul 06 12:34:28 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:29 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430" returned: 0 in 0.844s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.480s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1910496049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d18958-bce9-4d98-91d5-d110e6e500df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4462ca779446ed9cc70ebce9cf208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:25Z,use_quota=True,user_id='882ef555b762457dbe8c58ee54d76624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Creating volume 76d18958-bce9-4d98-91d5-d110e6e500df {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:29 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-76d18958-bce9-4d98-91d5-d110e6e500df 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:29 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-76d18958-bce9-4d98-91d5-d110e6e500df 1073741824 Jul 06 12:34:29 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cf2e73-7bc4-4f9a-9fdd-ab9ae2642356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf48855-da38-43b4-912c-d7b1c7cf6bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:29 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430 (90c6c9a8-a579-4e23-8bb2-8ebbddce6430): created successfully Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf48855-da38-43b4-912c-d7b1c7cf6bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Flow 'volume_create_manager' (44f62801-6553-4879-98a3-26574473a0cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:29 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-100c3e47-a39f-4f0f-80c7-640f7cc98c83 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Created volume successfully. Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Flow 'volume_create_manager' (4577da1d-7b73-4860-b436-74adce55ca31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc7205c-16bb-4a62-9f91-91ab3079f373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc7205c-16bb-4a62-9f91-91ab3079f373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1470790043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5026685e-62a3-45f9-8d92-fa35457c2bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d264df2a1b2447984d59ddb0adc87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:30Z,use_quota=True,user_id='df9adc2baa4e406d9d0df067e8c8dcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f01e269-0014-4249-a657-2b2e1d7a1c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f01e269-0014-4249-a657-2b2e1d7a1c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4c9b75-dcdf-485b-b555-b00b3658a43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4c9b75-dcdf-485b-b555-b00b3658a43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5026685e-62a3-45f9-8d92-fa35457c2bfe', 'volume_name': 'volume-5026685e-62a3-45f9-8d92-fa35457c2bfe', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cacce32-cd00-4ad4-8255-6bf972fdd967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cacce32-cd00-4ad4-8255-6bf972fdd967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5780913-0e17-4447-8aa8-90d8f9c069b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:30 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume 5026685e-62a3-45f9-8d92-fa35457c2bfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5026685e-62a3-45f9-8d92-fa35457c2bfe', 'volume_size': 1} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:30 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-76d18958-bce9-4d98-91d5-d110e6e500df 1073741824" returned: 0 in 1.186s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-76d18958-bce9-4d98-91d5-d110e6e500df {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:30 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-76d18958-bce9-4d98-91d5-d110e6e500df Jul 06 12:34:30 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Flow 'volume_create_manager' (4989b279-0707-4115-abfe-ac42810e35da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0650e9f2-d7e9-444c-8bda-7a0aaeb49c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0650e9f2-d7e9-444c-8bda-7a0aaeb49c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1813894930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a601e77c-fd24-4150-9494-059d91cf37a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d264df2a1b2447984d59ddb0adc87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:31Z,use_quota=True,user_id='df9adc2baa4e406d9d0df067e8c8dcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2cced8-7b52-45c7-9bcd-71b439d97380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2cced8-7b52-45c7-9bcd-71b439d97380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb7c202-aace-4d7c-83af-20db80bd39db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb7c202-aace-4d7c-83af-20db80bd39db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a601e77c-fd24-4150-9494-059d91cf37a1', 'volume_name': 'volume-a601e77c-fd24-4150-9494-059d91cf37a1', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50812492-3574-4c3c-9221-50fbb3fcc139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50812492-3574-4c3c-9221-50fbb3fcc139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b851b5d-49c0-46cd-b2e7-84dbaceec931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:31 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume a601e77c-fd24-4150-9494-059d91cf37a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a601e77c-fd24-4150-9494-059d91cf37a1', 'volume_size': 1} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Flow 'volume_create_manager' (e6b93bf0-b94a-43ee-a477-6f9acf4b2590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db548a9-1832-467c-b0ae-73f7ad30f341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db548a9-1832-467c-b0ae-73f7ad30f341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a990003d-8cd0-4eed-a51c-59f73914c8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e0a6f337dfc4060af2e0941912688ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:31Z,use_quota=True,user_id='6607b4c855784834993e7ee9b49ce1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(858614cc-2f24-4335-8202-d4085432f3f6),volume_type_id=858614cc-2f24-4335-8202-d4085432f3f6)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d394daba-84b5-4dfc-83c6-ff22423c81d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d394daba-84b5-4dfc-83c6-ff22423c81d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a179c49-2660-4f43-8057-d2bb22f567bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.image.glance [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Creating Keystone auth plugin from conf {{(pid=86761) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Flow 'volume_create_manager' (53275bb4-e647-4051-ab0c-102ae67f1667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0617865e-90a1-4f19-ba51-794bb3316e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0617865e-90a1-4f19-ba51-794bb3316e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1517692346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dec153c-7a76-48f2-bbee-04ce3c632bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d264df2a1b2447984d59ddb0adc87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:31Z,use_quota=True,user_id='df9adc2baa4e406d9d0df067e8c8dcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ea7a60-4e23-4401-86f5-3c41d96f9084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ea7a60-4e23-4401-86f5-3c41d96f9084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28a6794-0444-4155-a4df-8904cab1f2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28a6794-0444-4155-a4df-8904cab1f2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dec153c-7a76-48f2-bbee-04ce3c632bdb', 'volume_name': 'volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a19fe14-7766-47ba-9dd7-e1b509241da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a19fe14-7766-47ba-9dd7-e1b509241da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2db33f-ad71-4a3e-a57f-db9011aa32c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:31 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume 2dec153c-7a76-48f2-bbee-04ce3c632bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb', 'volume_size': 1} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:31 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-76d18958-bce9-4d98-91d5-d110e6e500df" returned: 0 in 1.196s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] <== create_volume: return (2469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.472s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.602s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-608998856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445c5989-020f-46ad-9c46-d7fc07fabe6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4462ca779446ed9cc70ebce9cf208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:26Z,use_quota=True,user_id='882ef555b762457dbe8c58ee54d76624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Creating volume 445c5989-020f-46ad-9c46-d7fc07fabe6d {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:31 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-445c5989-020f-46ad-9c46-d7fc07fabe6d 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9485b3e-8357-4847-a4a5-87a5291521fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d18958-bce9-4d98-91d5-d110e6e500df', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:31 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-445c5989-020f-46ad-9c46-d7fc07fabe6d 1073741824 Jul 06 12:34:31 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d36e6ab-2798-4d81-8942-03fef6c13e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:31 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Volume volume-76d18958-bce9-4d98-91d5-d110e6e500df (76d18958-bce9-4d98-91d5-d110e6e500df): created successfully Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d36e6ab-2798-4d81-8942-03fef6c13e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Flow 'volume_create_manager' (51da664f-8114-48a2-bdbf-b3c5ede28301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:32 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f4588262-f660-4a7e-97ce-dde12454f19c tempest-CreateVolumesFromImageTest-1151308564 None] Created volume successfully. Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a179c49-2660-4f43-8057-d2bb22f567bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a990003d-8cd0-4eed-a51c-59f73914c8b4', 'volume_name': 'volume-a990003d-8cd0-4eed-a51c-59f73914c8b4', 'volume_size': 1, 'image_id': '1cdae211-ff1d-45fa-a2d6-bef001bc69ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cdae211-ff1d-45fa-a2d6-bef001bc69ce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dce7633e1b0ed3bb9dcd91aca2e47914', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e0a6f337dfc4060af2e0941912688ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2bfb92a083944c36bfb1d9cb02552d5a39fe926f90ea7a55c13074e8c72cb4804bfd8b045e2d8298bb001a8b66472d9f927cfb98b09128f3daf53bdf3848d73b', 'id': '1cdae211-ff1d-45fa-a2d6-bef001bc69ce', 'created_at': datetime.datetime(2026, 7, 6, 10, 34, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 34, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cdae211-ff1d-45fa-a2d6-bef001bc69ce/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485ae026-40c7-4ef2-bbdd-466576771e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485ae026-40c7-4ef2-bbdd-466576771e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349c08ae-3c93-4256-ba8b-d13bd2999564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:32 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Volume a990003d-8cd0-4eed-a51c-59f73914c8b4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a990003d-8cd0-4eed-a51c-59f73914c8b4', 'volume_size': 1, 'image_id': '1cdae211-ff1d-45fa-a2d6-bef001bc69ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cdae211-ff1d-45fa-a2d6-bef001bc69ce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dce7633e1b0ed3bb9dcd91aca2e47914', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e0a6f337dfc4060af2e0941912688ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2bfb92a083944c36bfb1d9cb02552d5a39fe926f90ea7a55c13074e8c72cb4804bfd8b045e2d8298bb001a8b66472d9f927cfb98b09128f3daf53bdf3848d73b', 'id': '1cdae211-ff1d-45fa-a2d6-bef001bc69ce', 'created_at': datetime.datetime(2026, 7, 6, 10, 34, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 34, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cdae211-ff1d-45fa-a2d6-bef001bc69ce/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Trying to clone a990003d-8cd0-4eed-a51c-59f73914c8b4 from image 1cdae211-ff1d-45fa-a2d6-bef001bc69ce at location (None, [{'url': 'file:///opt/stack/data/glance/images/1cdae211-ff1d-45fa-a2d6-bef001bc69ce', 'metadata': {}}]). {{(pid=86761) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Flow 'volume_create_manager' (eaef9fb3-7cad-4189-92ae-e0327e5e4bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00c2f71-059a-432b-a5e1-787f0088aa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00c2f71-059a-432b-a5e1-787f0088aa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1309711922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e130293e-8a41-4493-8397-ae4d3e117060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d264df2a1b2447984d59ddb0adc87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:32Z,use_quota=True,user_id='df9adc2baa4e406d9d0df067e8c8dcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18719ed3-68f9-4ad3-bfcc-09416e6d5ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18719ed3-68f9-4ad3-bfcc-09416e6d5ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7b84d0-8187-4c17-b406-48a23f918588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7b84d0-8187-4c17-b406-48a23f918588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e130293e-8a41-4493-8397-ae4d3e117060', 'volume_name': 'volume-e130293e-8a41-4493-8397-ae4d3e117060', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227057f2-9993-454c-b22a-3dda62377add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227057f2-9993-454c-b22a-3dda62377add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1ef13b-acee-480b-9254-4250c740c084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:32 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume e130293e-8a41-4493-8397-ae4d3e117060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e130293e-8a41-4493-8397-ae4d3e117060', 'volume_size': 1} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:34:32 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Image download 0.00 MB at 0.00 MB/s Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[a941b460-2e1f-42b9-9b73-9ee1d50d9a92]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Flow 'volume_create_manager' (3ca4a8a3-a371-4fa2-bd9a-4deaf6d5fefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:32 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD Jul 06 12:34:32 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e19c02-a7ea-4eeb-9bae-b877be7d80f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e19c02-a7ea-4eeb-9bae-b877be7d80f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-797612303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d264df2a1b2447984d59ddb0adc87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:32Z,use_quota=True,user_id='df9adc2baa4e406d9d0df067e8c8dcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d61e0e-573f-44ea-8d7d-15564fbe8cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d61e0e-573f-44ea-8d7d-15564fbe8cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b25b00-5b42-48bd-b0cb-a290938e7dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b25b00-5b42-48bd-b0cb-a290938e7dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5', 'volume_name': 'volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ff0116-4179-4afb-8403-003c1d5880e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ff0116-4179-4afb-8403-003c1d5880e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44246d8b-d046-4800-9a4d-3e089021a3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:32 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume 2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5', 'volume_size': 1} Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:32 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-445c5989-020f-46ad-9c46-d7fc07fabe6d 1073741824" returned: 0 in 1.209s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-445c5989-020f-46ad-9c46-d7fc07fabe6d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:33 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-445c5989-020f-46ad-9c46-d7fc07fabe6d Jul 06 12:34:33 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:33 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD" returned: 0 in 0.900s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:33 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD Jul 06 12:34:33 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:33 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-445c5989-020f-46ad-9c46-d7fc07fabe6d" returned: 0 in 0.808s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.060s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1114207373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8e1915-b958-4019-a757-98c3ea23e785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4462ca779446ed9cc70ebce9cf208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:26Z,use_quota=True,user_id='882ef555b762457dbe8c58ee54d76624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Creating volume 2e8e1915-b958-4019-a757-98c3ea23e785 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:33 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2e8e1915-b958-4019-a757-98c3ea23e785 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:33 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2e8e1915-b958-4019-a757-98c3ea23e785 1073741824 Jul 06 12:34:33 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83de9c55-70ac-425e-9c7c-f573eadcf4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-445c5989-020f-46ad-9c46-d7fc07fabe6d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f09215-7b13-4f5f-bdff-b81c6ad70c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:33 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Volume volume-445c5989-020f-46ad-9c46-d7fc07fabe6d (445c5989-020f-46ad-9c46-d7fc07fabe6d): created successfully Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f09215-7b13-4f5f-bdff-b81c6ad70c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Flow 'volume_create_manager' (833e8bd1-3075-482e-9feb-e12ed19fd428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:33 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-e98adeb1-83b7-4ba5-ac14-ae289564be57 tempest-CreateVolumesFromImageTest-1151308564 None] Created volume successfully. Jul 06 12:34:34 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD" returned: 1 in 0.853s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:34:34 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Temporary image 1cdae211-ff1d-45fa-a2d6-bef001bc69ce is fetched for user 6607b4c855784834993e7ee9b49ce1a4. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:34:34 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebca7178-be3a-46af-97ed-fefdde3d5c95]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:34 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD Jul 06 12:34:34 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:34 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2e8e1915-b958-4019-a757-98c3ea23e785 1073741824" returned: 0 in 1.015s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2e8e1915-b958-4019-a757-98c3ea23e785 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:34 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2e8e1915-b958-4019-a757-98c3ea23e785 Jul 06 12:34:34 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:35 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD" returned: 0 in 0.883s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:35 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD Jul 06 12:34:35 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:35 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2e8e1915-b958-4019-a757-98c3ea23e785" returned: 0 in 0.868s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.624s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1614822633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ed44d7-901c-443a-b64e-098baf6fa21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4462ca779446ed9cc70ebce9cf208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:27Z,use_quota=True,user_id='882ef555b762457dbe8c58ee54d76624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Creating volume 84ed44d7-901c-443a-b64e-098baf6fa21f {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:35 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-84ed44d7-901c-443a-b64e-098baf6fa21f 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:35 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-84ed44d7-901c-443a-b64e-098baf6fa21f 1073741824 Jul 06 12:34:35 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2645f69f-9d9d-4da7-b3d0-20e68bf46694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8e1915-b958-4019-a757-98c3ea23e785', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c47a40-2ed4-4efa-bcf1-1a3737c4f8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:35 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Volume volume-2e8e1915-b958-4019-a757-98c3ea23e785 (2e8e1915-b958-4019-a757-98c3ea23e785): created successfully Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c47a40-2ed4-4efa-bcf1-1a3737c4f8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Flow 'volume_create_manager' (af49f333-0509-4d66-95be-d2b2ccbf5490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:35 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-62c6e3b5-b831-4b7e-bda0-d083bb957c2a tempest-CreateVolumesFromImageTest-1151308564 None] Created volume successfully. Jul 06 12:34:35 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD" returned: 1 in 0.854s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:34:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:36 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-84ed44d7-901c-443a-b64e-098baf6fa21f 1073741824" returned: 0 in 0.975s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-84ed44d7-901c-443a-b64e-098baf6fa21f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:36 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-84ed44d7-901c-443a-b64e-098baf6fa21f Jul 06 12:34:36 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:37 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-84ed44d7-901c-443a-b64e-098baf6fa21f" returned: 0 in 0.694s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.100s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1470790043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5026685e-62a3-45f9-8d92-fa35457c2bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d264df2a1b2447984d59ddb0adc87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:30Z,use_quota=True,user_id='df9adc2baa4e406d9d0df067e8c8dcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Creating volume 5026685e-62a3-45f9-8d92-fa35457c2bfe {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:37 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5026685e-62a3-45f9-8d92-fa35457c2bfe 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac3f6c1-dc76-4b96-9933-663beed605c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ed44d7-901c-443a-b64e-098baf6fa21f', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:37 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5026685e-62a3-45f9-8d92-fa35457c2bfe 1073741824 Jul 06 12:34:37 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c3e653-f74d-4f67-bea1-95cf4a6ed405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:37 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Volume volume-84ed44d7-901c-443a-b64e-098baf6fa21f (84ed44d7-901c-443a-b64e-098baf6fa21f): created successfully Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c3e653-f74d-4f67-bea1-95cf4a6ed405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Flow 'volume_create_manager' (1254e5a7-c354-4b6e-95d4-8fbb1badf6c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:37 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7c91b0ef-31fb-4bd7-9301-86609820000c tempest-CreateVolumesFromImageTest-1151308564 None] Created volume successfully. Jul 06 12:34:38 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5026685e-62a3-45f9-8d92-fa35457c2bfe 1073741824" returned: 0 in 0.926s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5026685e-62a3-45f9-8d92-fa35457c2bfe {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:38 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5026685e-62a3-45f9-8d92-fa35457c2bfe Jul 06 12:34:38 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "cinder-84ed44d7-901c-443a-b64e-098baf6fa21f-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-84ed44d7-901c-443a-b64e-098baf6fa21f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "cinder-quobyte-84ed44d7-901c-443a-b64e-098baf6fa21f" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-quobyte-84ed44d7-901c-443a-b64e-098baf6fa21f" acquired by "delete_volume" :: waited 0.015s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:38 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc268d81-08dd-47cf-93b6-1e483e22eb92]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-84ed44d7-901c-443a-b64e-098baf6fa21f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:38 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-84ed44d7-901c-443a-b64e-098baf6fa21f Jul 06 12:34:38 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:39 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5026685e-62a3-45f9-8d92-fa35457c2bfe" returned: 0 in 0.801s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.240s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1813894930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a601e77c-fd24-4150-9494-059d91cf37a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d264df2a1b2447984d59ddb0adc87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:31Z,use_quota=True,user_id='df9adc2baa4e406d9d0df067e8c8dcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Creating volume a601e77c-fd24-4150-9494-059d91cf37a1 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:39 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a601e77c-fd24-4150-9494-059d91cf37a1 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:39 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a601e77c-fd24-4150-9494-059d91cf37a1 1073741824 Jul 06 12:34:39 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5780913-0e17-4447-8aa8-90d8f9c069b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5026685e-62a3-45f9-8d92-fa35457c2bfe', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7fc6d73-9372-4946-a185-1abec15d0092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:39 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume volume-5026685e-62a3-45f9-8d92-fa35457c2bfe (5026685e-62a3-45f9-8d92-fa35457c2bfe): created successfully Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7fc6d73-9372-4946-a185-1abec15d0092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Flow 'volume_create_manager' (4577da1d-7b73-4860-b436-74adce55ca31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:39 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a748a598-04d3-4853-bde8-395eaba27e32 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Created volume successfully. Jul 06 12:34:39 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-84ed44d7-901c-443a-b64e-098baf6fa21f" returned: 0 in 0.899s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-84ed44d7-901c-443a-b64e-098baf6fa21f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:39 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-84ed44d7-901c-443a-b64e-098baf6fa21f Jul 06 12:34:39 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:40 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a601e77c-fd24-4150-9494-059d91cf37a1 1073741824" returned: 0 in 0.979s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a601e77c-fd24-4150-9494-059d91cf37a1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:40 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a601e77c-fd24-4150-9494-059d91cf37a1 Jul 06 12:34:40 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:40 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-84ed44d7-901c-443a-b64e-098baf6fa21f" returned: 0 in 0.768s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-quobyte-84ed44d7-901c-443a-b64e-098baf6fa21f" released by "delete_volume" :: held 1.722s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:40 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Created reservations ['02ce33a4-ac5b-4fbc-9074-cfda3e2f09b9', 'f24ed4e6-e5de-4dc8-b341-b302a86a76d5', 'c558e3bb-5f53-4768-928c-2424c6dcddbd', '24dc92cc-c014-4ebd-b60e-85daf639ebd2'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:40 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:34:40 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "cinder-2e8e1915-b958-4019-a757-98c3ea23e785-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-2e8e1915-b958-4019-a757-98c3ea23e785-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "cinder-quobyte-2e8e1915-b958-4019-a757-98c3ea23e785" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-quobyte-2e8e1915-b958-4019-a757-98c3ea23e785" acquired by "delete_volume" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f21b49f-ee29-4b62-a646-5103c3b51e8e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2e8e1915-b958-4019-a757-98c3ea23e785 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:41 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a601e77c-fd24-4150-9494-059d91cf37a1" returned: 0 in 0.842s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.572s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1517692346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dec153c-7a76-48f2-bbee-04ce3c632bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d264df2a1b2447984d59ddb0adc87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:31Z,use_quota=True,user_id='df9adc2baa4e406d9d0df067e8c8dcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Creating volume 2dec153c-7a76-48f2-bbee-04ce3c632bdb {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:41 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b851b5d-49c0-46cd-b2e7-84dbaceec931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a601e77c-fd24-4150-9494-059d91cf37a1', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd53d330-9dc2-442f-83ab-ab74506d5b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:41 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb 1073741824 Jul 06 12:34:41 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:41 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume volume-a601e77c-fd24-4150-9494-059d91cf37a1 (a601e77c-fd24-4150-9494-059d91cf37a1): created successfully Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd53d330-9dc2-442f-83ab-ab74506d5b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Flow 'volume_create_manager' (4989b279-0707-4115-abfe-ac42810e35da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:41 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2e8e1915-b958-4019-a757-98c3ea23e785 Jul 06 12:34:41 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:41 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-36920c86-87d5-4768-8801-f8e5904bfa98 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Created volume successfully. Jul 06 12:34:41 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.889s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:41 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Deleted volume successfully. Jul 06 12:34:41 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dd174b90-ee3c-49ef-8eb3-4df9ac9e327b tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-84ed44d7-901c-443a-b64e-098baf6fa21f-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:42 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2e8e1915-b958-4019-a757-98c3ea23e785" returned: 0 in 0.963s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2e8e1915-b958-4019-a757-98c3ea23e785 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:42 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2e8e1915-b958-4019-a757-98c3ea23e785 Jul 06 12:34:42 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:42 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb 1073741824" returned: 0 in 1.217s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:42 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb Jul 06 12:34:42 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:42 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2e8e1915-b958-4019-a757-98c3ea23e785" returned: 0 in 0.739s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-quobyte-2e8e1915-b958-4019-a757-98c3ea23e785" released by "delete_volume" :: held 1.775s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:42 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Created reservations ['85fc2805-d79e-46e2-8fe5-2c25e0e7ec46', '56250db5-d772-48c4-b4a8-0c4e82414248', 'e88cf460-9b35-4de5-a21e-bb2041ba81ca', 'd1952889-dc5b-48ef-8f97-ebca8362e1c5'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:42 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:34:42 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:43 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb" returned: 0 in 0.691s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.842s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1309711922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e130293e-8a41-4493-8397-ae4d3e117060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d264df2a1b2447984d59ddb0adc87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:32Z,use_quota=True,user_id='df9adc2baa4e406d9d0df067e8c8dcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Creating volume e130293e-8a41-4493-8397-ae4d3e117060 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:43 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e130293e-8a41-4493-8397-ae4d3e117060 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2db33f-ad71-4a3e-a57f-db9011aa32c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:43 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e130293e-8a41-4493-8397-ae4d3e117060 1073741824 Jul 06 12:34:43 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff90879-8439-46a0-aee6-d2409db72177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:43 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb (2dec153c-7a76-48f2-bbee-04ce3c632bdb): created successfully Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff90879-8439-46a0-aee6-d2409db72177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Flow 'volume_create_manager' (53275bb4-e647-4051-ab0c-102ae67f1667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:43 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-dbe7b2ed-d869-4d06-8463-5303bc31baaa tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Created volume successfully. Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "cinder-445c5989-020f-46ad-9c46-d7fc07fabe6d-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-445c5989-020f-46ad-9c46-d7fc07fabe6d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "cinder-quobyte-445c5989-020f-46ad-9c46-d7fc07fabe6d" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-quobyte-445c5989-020f-46ad-9c46-d7fc07fabe6d" acquired by "delete_volume" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[2307a892-3b14-4639-864a-979060849ba1]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-445c5989-020f-46ad-9c46-d7fc07fabe6d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:43 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-445c5989-020f-46ad-9c46-d7fc07fabe6d Jul 06 12:34:43 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:43 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.973s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:43 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Deleted volume successfully. Jul 06 12:34:43 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c1bdab8-4232-4978-965a-3a343d7ba9c6 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-2e8e1915-b958-4019-a757-98c3ea23e785-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:44 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e130293e-8a41-4493-8397-ae4d3e117060 1073741824" returned: 0 in 1.157s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e130293e-8a41-4493-8397-ae4d3e117060 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:44 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e130293e-8a41-4493-8397-ae4d3e117060 Jul 06 12:34:44 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:44 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-445c5989-020f-46ad-9c46-d7fc07fabe6d" returned: 0 in 0.972s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-445c5989-020f-46ad-9c46-d7fc07fabe6d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:44 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-445c5989-020f-46ad-9c46-d7fc07fabe6d Jul 06 12:34:44 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:45 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e130293e-8a41-4493-8397-ae4d3e117060" returned: 0 in 0.756s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.519s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-797612303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d264df2a1b2447984d59ddb0adc87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:32Z,use_quota=True,user_id='df9adc2baa4e406d9d0df067e8c8dcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Creating volume 2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:45 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1ef13b-acee-480b-9254-4250c740c084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e130293e-8a41-4493-8397-ae4d3e117060', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479dc0dd-6d59-4a15-af5c-f62fc7a68705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:45 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5 1073741824 Jul 06 12:34:45 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:45 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume volume-e130293e-8a41-4493-8397-ae4d3e117060 (e130293e-8a41-4493-8397-ae4d3e117060): created successfully Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479dc0dd-6d59-4a15-af5c-f62fc7a68705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Flow 'volume_create_manager' (eaef9fb3-7cad-4189-92ae-e0327e5e4bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:45 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:45 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ba04e602-b6bb-46e9-913b-328d5e718512 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Created volume successfully. Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-445c5989-020f-46ad-9c46-d7fc07fabe6d" returned: 0 in 0.742s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-quobyte-445c5989-020f-46ad-9c46-d7fc07fabe6d" released by "delete_volume" :: held 1.783s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Created reservations ['23680b8a-049f-400a-b31e-76e8d2308c37', 'cf569224-2274-488d-ab47-4722f53b24b8', '5669bf3d-0824-4ada-a4ab-317e885a6159', '17179540-8822-4b41-baee-b9efd4c56bf8'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:45 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:34:45 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "cinder-76d18958-bce9-4d98-91d5-d110e6e500df-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-76d18958-bce9-4d98-91d5-d110e6e500df-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "cinder-quobyte-76d18958-bce9-4d98-91d5-d110e6e500df" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-quobyte-76d18958-bce9-4d98-91d5-d110e6e500df" acquired by "delete_volume" :: waited 0.027s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f00bed-24f1-459e-94f0-ce0acccd21bc]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-76d18958-bce9-4d98-91d5-d110e6e500df {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:45 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-76d18958-bce9-4d98-91d5-d110e6e500df Jul 06 12:34:45 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:46 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5 1073741824" returned: 0 in 1.199s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:46 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.980s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:46 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:46 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Deleted volume successfully. Jul 06 12:34:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:46 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d14da06d-f177-4538-9135-9e428fa89e50 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-445c5989-020f-46ad-9c46-d7fc07fabe6d-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:46 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5 Jul 06 12:34:46 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:46 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-76d18958-bce9-4d98-91d5-d110e6e500df" returned: 0 in 1.090s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-76d18958-bce9-4d98-91d5-d110e6e500df {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:46 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-76d18958-bce9-4d98-91d5-d110e6e500df Jul 06 12:34:46 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:47 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5" returned: 0 in 0.729s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.157s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a990003d-8cd0-4eed-a51c-59f73914c8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e0a6f337dfc4060af2e0941912688ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:31Z,use_quota=True,user_id='6607b4c855784834993e7ee9b49ce1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(858614cc-2f24-4335-8202-d4085432f3f6),volume_type_id=858614cc-2f24-4335-8202-d4085432f3f6)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Creating volume a990003d-8cd0-4eed-a51c-59f73914c8b4 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:47 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44246d8b-d046-4800-9a4d-3e089021a3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413aa9a8-be56-4b58-89bf-969ce7bfd6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:47 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Volume volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5 (2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5): created successfully Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413aa9a8-be56-4b58-89bf-969ce7bfd6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:47 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 1073741824 Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Flow 'volume_create_manager' (3ca4a8a3-a371-4fa2-bd9a-4deaf6d5fefc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:47 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:47 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-028d2d88-ef04-4244-8a6e-b8b51095e65f tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Created volume successfully. Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-76d18958-bce9-4d98-91d5-d110e6e500df" returned: 0 in 0.772s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:47 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-quobyte-76d18958-bce9-4d98-91d5-d110e6e500df" released by "delete_volume" :: held 1.919s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Created reservations ['518f13a8-43a2-4ec0-8d96-ce220476c028', '63c248cb-b50e-4ad2-89af-066cb45b7b08', 'f6672ad0-84b6-4345-93bd-627585a1b19e', 'e6b6b124-7710-4123-8114-e0f5d34c4738'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "cinder-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "cinder-aca3152d-44d1-487a-ad9b-0cc661d534da-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:48 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:34:48 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "cinder-quobyte-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-aca3152d-44d1-487a-ad9b-0cc661d534da-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-quobyte-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5" acquired by "delete_volume" :: waited 0.041s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[48163300-4b8c-49d6-8eea-16a04bf626e9]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "cinder-quobyte-aca3152d-44d1-487a-ad9b-0cc661d534da" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:48 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-quobyte-aca3152d-44d1-487a-ad9b-0cc661d534da" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 1073741824" returned: 0 in 1.155s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[19871540-63b8-4c7c-b783-c01409e7993d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aca3152d-44d1-487a-ad9b-0cc661d534da {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:48 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5 Jul 06 12:34:48 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:48 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 Jul 06 12:34:48 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:48 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aca3152d-44d1-487a-ad9b-0cc661d534da Jul 06 12:34:48 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:48 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.806s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:48 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Deleted volume successfully. Jul 06 12:34:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a4ca09ae-233e-4e1d-87a0-728e778b6d68 tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-76d18958-bce9-4d98-91d5-d110e6e500df-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:49 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5" returned: 0 in 1.028s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:49 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5 Jul 06 12:34:49 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:49 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aca3152d-44d1-487a-ad9b-0cc661d534da" returned: 0 in 0.999s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aca3152d-44d1-487a-ad9b-0cc661d534da {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:49 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aca3152d-44d1-487a-ad9b-0cc661d534da Jul 06 12:34:49 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:49 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4" returned: 0 in 1.046s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] <== create_volume: return (2291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.295s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:49 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Attempting download of 1cdae211-ff1d-45fa-a2d6-bef001bc69ce ((None, [{'url': 'file:///opt/stack/data/glance/images/1cdae211-ff1d-45fa-a2d6-bef001bc69ce', 'metadata': {}}])) to volume a990003d-8cd0-4eed-a51c-59f73914c8b4. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:34:49 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3f6cdc-ba87-4fce-88a3-d87fffa0eb3c]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cdae211-ff1d-45fa-a2d6-bef001bc69ce__y_ok4kb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:49 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cdae211-ff1d-45fa-a2d6-bef001bc69ce__y_ok4kb Jul 06 12:34:49 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:50 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5" returned: 0 in 0.962s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-quobyte-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5" released by "delete_volume" :: held 2.064s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Created reservations ['45ed6466-57f8-4330-b292-2f3f927d8f05', '014639f5-d6d5-4971-9a1d-0992d99ebfd2', 'aa6ef2c6-81ac-44ba-8c45-0092d1031ce7', '1c635c19-cb4b-482f-9fd9-8b663c7fe4a2'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:50 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aca3152d-44d1-487a-ad9b-0cc661d534da" returned: 0 in 1.095s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:50 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:34:50 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-quobyte-aca3152d-44d1-487a-ad9b-0cc661d534da" released by "delete_volume" :: held 2.181s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Created reservations ['708abff3-8aa8-438d-945e-52e0b1ef2885', '43c38a5b-62f0-41b1-b088-93c35f10cec1', '19d0b562-fce4-4915-b513-e0a9406ad353', '25445e1f-9da3-4b23-807e-9bdf2321efd8'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:50 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:34:50 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:50 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cdae211-ff1d-45fa-a2d6-bef001bc69ce__y_ok4kb" returned: 0 in 1.264s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cdae211-ff1d-45fa-a2d6-bef001bc69ce__y_ok4kb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:51 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cdae211-ff1d-45fa-a2d6-bef001bc69ce__y_ok4kb Jul 06 12:34:51 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:51 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.988s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:51 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Deleted volume successfully. Jul 06 12:34:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7594103f-ad31-4a4d-ac00-988efcdd93bb tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-2a71fe9e-145d-4a92-bbc1-afb6cd3cb4c5-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "cinder-e130293e-8a41-4493-8397-ae4d3e117060-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-e130293e-8a41-4493-8397-ae4d3e117060-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "cinder-quobyte-e130293e-8a41-4493-8397-ae4d3e117060" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:51 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.902s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:51 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Deleted volume successfully. Jul 06 12:34:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-quobyte-e130293e-8a41-4493-8397-ae4d3e117060" acquired by "delete_volume" :: waited 0.048s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7f5219cc-91df-4733-9af5-9f270f22ee9c tempest-CreateVolumesFromImageTest-1151308564 None] Lock "cinder-aca3152d-44d1-487a-ad9b-0cc661d534da-delete_volume" released by "delete_volume" :: held 3.536s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:51 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42d741b-0c33-4a78-add2-64216bf13bde]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e130293e-8a41-4493-8397-ae4d3e117060 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:51 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e130293e-8a41-4493-8397-ae4d3e117060 Jul 06 12:34:51 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:52 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cdae211-ff1d-45fa-a2d6-bef001bc69ce__y_ok4kb" returned: 1 in 1.298s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cdae211-ff1d-45fa-a2d6-bef001bc69ce__y_ok4kb' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:34:52 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[b076f9f9-445c-432a-be7d-de1f719c235e]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:52 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD Jul 06 12:34:52 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:34:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:52 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:34:52 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:53 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e130293e-8a41-4493-8397-ae4d3e117060" returned: 0 in 1.419s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e130293e-8a41-4493-8397-ae4d3e117060 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:53 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e130293e-8a41-4493-8397-ae4d3e117060 Jul 06 12:34:53 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:53 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD" returned: 0 in 1.126s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:53 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD Jul 06 12:34:53 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:53 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.125s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:34:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:34:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:34:54 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-e130293e-8a41-4493-8397-ae4d3e117060" returned: 0 in 1.034s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-quobyte-e130293e-8a41-4493-8397-ae4d3e117060" released by "delete_volume" :: held 2.532s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:54 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD" returned: 1 in 0.932s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:34:54 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] 1cdae211-ff1d-45fa-a2d6-bef001bc69ce was raw, converting to raw {{(pid=86761) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:34:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:54 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 Jul 06 12:34:54 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:54 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Created reservations ['bd95344d-0f4f-4c16-84a6-b11711f7a4d9', '35df657d-f0a3-4bea-905e-3321465e9799', '38346bfa-c897-4df7-a307-9832df9c5985', 'ad2f0b65-2cb3-47ef-99d4-fcbdaa398d23'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:54 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:34:54 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "cinder-2dec153c-7a76-48f2-bbee-04ce3c632bdb-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-2dec153c-7a76-48f2-bbee-04ce3c632bdb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "cinder-quobyte-2dec153c-7a76-48f2-bbee-04ce3c632bdb" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-quobyte-2dec153c-7a76-48f2-bbee-04ce3c632bdb" acquired by "delete_volume" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:55 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f468ce0-6605-437d-95a6-c7e58e74e8d7]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:55 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb Jul 06 12:34:55 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:55 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.259s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:55 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:55 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Deleted volume successfully. Jul 06 12:34:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0dc48b58-60fb-428e-b44c-b490de9e19f0 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-e130293e-8a41-4493-8397-ae4d3e117060-delete_volume" released by "delete_volume" :: held 4.278s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:55 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4" returned: 0 in 1.609s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:55 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1cdae211-ff1d-45fa-a2d6-bef001bc69ce_gqlr6fo3devstack@QuobyteHD, size 0.00 MB, duration 1.61 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:34:55 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 12:34:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:55 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 1G Jul 06 12:34:55 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:56 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb" returned: 0 in 1.644s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:56 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 1G" returned: 0 in 1.176s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:57 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb Jul 06 12:34:57 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:57 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[394398b8-0080-4f93-9f99-7d55b279d687]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:57 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 Jul 06 12:34:57 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:57 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-2dec153c-7a76-48f2-bbee-04ce3c632bdb" returned: 0 in 0.982s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-quobyte-2dec153c-7a76-48f2-bbee-04ce3c632bdb" released by "delete_volume" :: held 2.714s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Created reservations ['b23b40f5-6741-40d7-a1cf-ea664a64a128', '7dfce7c3-636a-4941-9a08-96d8b86e0d1d', '30a4e601-a34d-4fde-a6a4-1330461908d4', 'bf4f459c-cfd0-4355-8611-da8582a39913'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:58 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4" returned: 0 in 1.130s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:58 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:34:58 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:58 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 Jul 06 12:34:58 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Flow 'volume_create_manager' (a6d77433-5f91-4ca8-bcf7-9dae07d6cbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be294e2e-ac8d-4169-8b60-3bb184415c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be294e2e-ac8d-4169-8b60-3bb184415c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2144039891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9a8017-b92c-4b9c-b640-36f423999350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6302eb594bd0448a8417c8612901d214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:58Z,use_quota=True,user_id='c943115ac4204732b425727069ec1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49df9a45-3ba8-4c76-9d1b-c6f8aaf06d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49df9a45-3ba8-4c76-9d1b-c6f8aaf06d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d80ddd6-175b-4e4a-83cf-74f259b4bacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d80ddd6-175b-4e4a-83cf-74f259b4bacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e9a8017-b92c-4b9c-b640-36f423999350', 'volume_name': 'volume-5e9a8017-b92c-4b9c-b640-36f423999350', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886599b5-e5ff-478a-a597-564a549223b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886599b5-e5ff-478a-a597-564a549223b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe5d22b-f3c9-410c-872c-e791854493a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:58 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume 5e9a8017-b92c-4b9c-b640-36f423999350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e9a8017-b92c-4b9c-b640-36f423999350', 'volume_size': 1} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2144039891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9a8017-b92c-4b9c-b640-36f423999350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6302eb594bd0448a8417c8612901d214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:58Z,use_quota=True,user_id='c943115ac4204732b425727069ec1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Creating volume 5e9a8017-b92c-4b9c-b640-36f423999350 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:58 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "cinder-a601e77c-fd24-4150-9494-059d91cf37a1-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:58 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350 1073741824 Jul 06 12:34:58 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-a601e77c-fd24-4150-9494-059d91cf37a1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "cinder-quobyte-a601e77c-fd24-4150-9494-059d91cf37a1" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-quobyte-a601e77c-fd24-4150-9494-059d91cf37a1" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1a5e89-955c-493b-8496-d3f9f2314629]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a601e77c-fd24-4150-9494-059d91cf37a1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:59 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a601e77c-fd24-4150-9494-059d91cf37a1 Jul 06 12:34:59 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:59 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.090s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:59 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Deleted volume successfully. Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-21a99680-e561-446c-95da-0aee56aee83b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-2dec153c-7a76-48f2-bbee-04ce3c632bdb-delete_volume" released by "delete_volume" :: held 4.196s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:59 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4" returned: 1 in 1.250s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Downloaded image 1cdae211-ff1d-45fa-a2d6-bef001bc69ce ((None, [{'url': 'file:///opt/stack/data/glance/images/1cdae211-ff1d-45fa-a2d6-bef001bc69ce', 'metadata': {}}])) to volume a990003d-8cd0-4eed-a51c-59f73914c8b4 successfully. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Temporary image 1cdae211-ff1d-45fa-a2d6-bef001bc69ce for user 6607b4c855784834993e7ee9b49ce1a4 is deleted. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Marking volume a990003d-8cd0-4eed-a51c-59f73914c8b4 as bootable. {{(pid=86761) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Copying metadata from image 1cdae211-ff1d-45fa-a2d6-bef001bc69ce to a990003d-8cd0-4eed-a51c-59f73914c8b4. {{(pid=86761) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Creating volume glance metadata for volume a990003d-8cd0-4eed-a51c-59f73914c8b4 backed by image 1cdae211-ff1d-45fa-a2d6-bef001bc69ce with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1cdae211-ff1d-45fa-a2d6-bef001bc69ce', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'dce7633e1b0ed3bb9dcd91aca2e47914', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86761) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349c08ae-3c93-4256-ba8b-d13bd2999564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a990003d-8cd0-4eed-a51c-59f73914c8b4', 'volume_size': 1, 'image_id': '1cdae211-ff1d-45fa-a2d6-bef001bc69ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cdae211-ff1d-45fa-a2d6-bef001bc69ce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dce7633e1b0ed3bb9dcd91aca2e47914', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e0a6f337dfc4060af2e0941912688ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2bfb92a083944c36bfb1d9cb02552d5a39fe926f90ea7a55c13074e8c72cb4804bfd8b045e2d8298bb001a8b66472d9f927cfb98b09128f3daf53bdf3848d73b', 'id': '1cdae211-ff1d-45fa-a2d6-bef001bc69ce', 'created_at': datetime.datetime(2026, 7, 6, 10, 34, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 34, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cdae211-ff1d-45fa-a2d6-bef001bc69ce/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352507c4-43ea-4b36-8e72-be3b05707bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:59 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Volume volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 (a990003d-8cd0-4eed-a51c-59f73914c8b4): created successfully Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352507c4-43ea-4b36-8e72-be3b05707bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Flow 'volume_create_manager' (e6b93bf0-b94a-43ee-a477-6f9acf4b2590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:59 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-9312fb1b-c4a3-4e41-89ab-ab6140ee9b5d tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Created volume successfully. Jul 06 12:34:59 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350 1073741824" returned: 0 in 1.272s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:59 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350 Jul 06 12:34:59 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:00 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a601e77c-fd24-4150-9494-059d91cf37a1" returned: 0 in 1.125s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a601e77c-fd24-4150-9494-059d91cf37a1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:00 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a601e77c-fd24-4150-9494-059d91cf37a1 Jul 06 12:35:00 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:00 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350" returned: 0 in 0.713s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe5d22b-f3c9-410c-872c-e791854493a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e9a8017-b92c-4b9c-b640-36f423999350', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833cf8cd-9188-4fc9-bea6-edfb19a4c4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:00 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume volume-5e9a8017-b92c-4b9c-b640-36f423999350 (5e9a8017-b92c-4b9c-b640-36f423999350): created successfully Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833cf8cd-9188-4fc9-bea6-edfb19a4c4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Flow 'volume_create_manager' (a6d77433-5f91-4ca8-bcf7-9dae07d6cbcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:00 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6cbbfb72-4883-4f2e-ab85-d9941a6da31f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Created volume successfully. Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Acquiring lock "cinder-a990003d-8cd0-4eed-a51c-59f73914c8b4-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:00 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Lock "cinder-a990003d-8cd0-4eed-a51c-59f73914c8b4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a601e77c-fd24-4150-9494-059d91cf37a1" returned: 0 in 0.761s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-quobyte-a601e77c-fd24-4150-9494-059d91cf37a1" released by "delete_volume" :: held 1.972s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Acquiring lock "cinder-quobyte-a990003d-8cd0-4eed-a51c-59f73914c8b4" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Lock "cinder-quobyte-a990003d-8cd0-4eed-a51c-59f73914c8b4" acquired by "delete_volume" :: waited 0.037s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:00 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Created reservations ['e8e1fa81-4298-4dc1-b17c-e71ad74a03ff', 'e0077531-10f5-448b-8036-2dccd775b234', '055faa6e-a7be-42e6-865b-976e3c7464d0', '990e5bbf-0d7e-43eb-bcc0-44d7affe229b'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:35:01 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[669e691b-676c-4e65-989c-dc49a9c52d1d]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:01 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:35:01 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:01 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 Jul 06 12:35:01 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:01 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4" returned: 0 in 0.865s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:01 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.873s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:01 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:35:01 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Deleted volume successfully. Jul 06 12:35:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:02 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Creating offline snapshot c99cdc52-f52e-42f6-a6ec-edfe686b00d0 of volume 5e9a8017-b92c-4b9c-b640-36f423999350 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:35:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b846a5a6-0abb-4410-bb5b-3a6a503a969b tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-a601e77c-fd24-4150-9494-059d91cf37a1-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:02 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[03757b1d-e97c-4822-b67d-a7a8f18def64]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:02 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 Jul 06 12:35:02 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "cinder-5026685e-62a3-45f9-8d92-fa35457c2bfe-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-5026685e-62a3-45f9-8d92-fa35457c2bfe-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:02 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350 Jul 06 12:35:02 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "cinder-quobyte-5026685e-62a3-45f9-8d92-fa35457c2bfe" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-quobyte-5026685e-62a3-45f9-8d92-fa35457c2bfe" acquired by "delete_volume" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:02 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[adea7820-f01c-4f9d-8aa8-f91f22d945ca]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5026685e-62a3-45f9-8d92-fa35457c2bfe {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:02 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5026685e-62a3-45f9-8d92-fa35457c2bfe Jul 06 12:35:02 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:02 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:02 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4" returned: 1 in 1.121s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:35:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350" returned: 0 in 0.949s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:03 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4 Jul 06 12:35:03 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:03 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0 1G Jul 06 12:35:03 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:03 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5026685e-62a3-45f9-8d92-fa35457c2bfe" returned: 0 in 1.285s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5026685e-62a3-45f9-8d92-fa35457c2bfe {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:03 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5026685e-62a3-45f9-8d92-fa35457c2bfe Jul 06 12:35:03 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:03 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a990003d-8cd0-4eed-a51c-59f73914c8b4" returned: 0 in 0.824s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Lock "cinder-quobyte-a990003d-8cd0-4eed-a51c-59f73914c8b4" released by "delete_volume" :: held 2.898s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:03 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Created reservations ['52ed65f8-02ce-47d0-bc71-b65cf1dd0bc5', '1b6cc3ef-2175-4371-a6ff-66f5fb4518bd', 'b9388f86-2616-457b-b1ae-00feb6e847d1', '58474475-e32f-40be-9ce1-bba8a90779e2'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:35:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:04 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:35:04 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:04 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0 1G" returned: 0 in 1.387s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e9a8017-b92c-4b9c-b640-36f423999350 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:04 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e9a8017-b92c-4b9c-b640-36f423999350 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0 Jul 06 12:35:04 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:04 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5026685e-62a3-45f9-8d92-fa35457c2bfe" returned: 0 in 1.280s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-quobyte-5026685e-62a3-45f9-8d92-fa35457c2bfe" released by "delete_volume" :: held 2.628s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Created reservations ['0375197b-51bb-4a9c-86f9-3c0827181368', '72dfb292-30c0-477f-9840-da8642842b38', '92a60e40-801a-4321-8aec-3af3b4a58cf6', 'cf6067d6-6939-4899-9d9a-92749c8cdbbd'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:05 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:35:05 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:05 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.280s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:35:05 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Deleted volume successfully. Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-996fe766-ac4a-43f2-a7ba-2789af2654e4 tempest-VolumeAndVolumeTypeFromImageTest-1598410982 None] Lock "cinder-a990003d-8cd0-4eed-a51c-59f73914c8b4-delete_volume" released by "delete_volume" :: held 4.576s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "cinder-90c6c9a8-a579-4e23-8bb2-8ebbddce6430-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-90c6c9a8-a579-4e23-8bb2-8ebbddce6430-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "cinder-quobyte-90c6c9a8-a579-4e23-8bb2-8ebbddce6430" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-quobyte-90c6c9a8-a579-4e23-8bb2-8ebbddce6430" acquired by "delete_volume" :: waited 0.029s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec52648-3484-4ef5-8f14-bc6eb1cd3619]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:05 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e9a8017-b92c-4b9c-b640-36f423999350 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0" returned: 0 in 1.378s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:05 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0 is being set with open permissions: ugo+rw Jul 06 12:35:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:05 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0 Jul 06 12:35:05 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:05 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430 Jul 06 12:35:05 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:06 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.136s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:06 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:35:06 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Deleted volume successfully. Jul 06 12:35:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8213f92-6193-4ce1-a6dd-9d3393ba95ba tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-5026685e-62a3-45f9-8d92-fa35457c2bfe-delete_volume" released by "delete_volume" :: held 4.288s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:06 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0" returned: 0 in 1.069s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:06 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.info Jul 06 12:35:06 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:07 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430" returned: 0 in 1.585s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:07 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430 Jul 06 12:35:07 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:07 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.info" returned: 0 in 1.065s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:07 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.info is being set with open permissions: ugo+rw Jul 06 12:35:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:08 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.info Jul 06 12:35:08 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:08 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-90c6c9a8-a579-4e23-8bb2-8ebbddce6430" returned: 0 in 0.947s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-quobyte-90c6c9a8-a579-4e23-8bb2-8ebbddce6430" released by "delete_volume" :: held 2.610s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:08 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Created reservations ['bd2747f4-8cf6-4825-b63f-f76819544a0e', 'b1ea92bf-65ca-4f1e-9b1d-82dc2fc70391', '56bfe574-edc6-486d-a491-81aace89621b', '87d39ee2-9804-4201-a4c3-7a512d404a2e'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:35:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:08 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:35:08 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:09 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.info" returned: 0 in 1.126s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.189s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:09 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-e665392d-6d90-47a1-8be2-bfae57090993 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Create snapshot completed successfully Jul 06 12:35:09 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.287s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:09 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:35:09 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Deleted volume successfully. Jul 06 12:35:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-367298ea-7b89-4fc7-acfe-91733551eff6 tempest-CreateVolumesFromSourceVolumeTest-714512744 None] Lock "cinder-90c6c9a8-a579-4e23-8bb2-8ebbddce6430-delete_volume" released by "delete_volume" :: held 4.256s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Flow 'volume_create_manager' (7eb2e290-434e-4a3b-971a-e80243db97bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec549d2-2011-4af8-975c-d67f709463d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec549d2-2011-4af8-975c-d67f709463d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2036767165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64eb3fb3-9ccc-4c46-af01-00cef0352575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6302eb594bd0448a8417c8612901d214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:10Z,use_quota=True,user_id='c943115ac4204732b425727069ec1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d478258-4a4a-47a7-8f3c-3a68c9f1d991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d478258-4a4a-47a7-8f3c-3a68c9f1d991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92cad5f-3839-4720-91a6-5fa50ed795d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92cad5f-3839-4720-91a6-5fa50ed795d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64eb3fb3-9ccc-4c46-af01-00cef0352575', 'volume_name': 'volume-64eb3fb3-9ccc-4c46-af01-00cef0352575', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff822bc2-ec04-4c96-9b80-bbb59e7251dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff822bc2-ec04-4c96-9b80-bbb59e7251dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9420b4a-5d8a-4532-87e8-c5904fd1e46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:10 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume 64eb3fb3-9ccc-4c46-af01-00cef0352575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64eb3fb3-9ccc-4c46-af01-00cef0352575', 'volume_size': 1} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2036767165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64eb3fb3-9ccc-4c46-af01-00cef0352575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6302eb594bd0448a8417c8612901d214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:10Z,use_quota=True,user_id='c943115ac4204732b425727069ec1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Creating volume 64eb3fb3-9ccc-4c46-af01-00cef0352575 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:35:10 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:35:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-64eb3fb3-9ccc-4c46-af01-00cef0352575 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:10 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-64eb3fb3-9ccc-4c46-af01-00cef0352575 1073741824 Jul 06 12:35:10 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Flow 'volume_create_manager' (96fba043-b9b4-428c-bf72-50346529eccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813aac08-c107-4d7b-b424-1c54342b932c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813aac08-c107-4d7b-b424-1c54342b932c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1821431180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bab5df-db01-40db-9e28-f6a192356091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6302eb594bd0448a8417c8612901d214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:11Z,use_quota=True,user_id='c943115ac4204732b425727069ec1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b204609-45dc-4781-b548-80ae64d8cdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b204609-45dc-4781-b548-80ae64d8cdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c2b174-7e94-423a-9d7a-219afdcf3e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c2b174-7e94-423a-9d7a-219afdcf3e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42bab5df-db01-40db-9e28-f6a192356091', 'volume_name': 'volume-42bab5df-db01-40db-9e28-f6a192356091', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae99f4f-6568-41bb-8c78-7128703088aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae99f4f-6568-41bb-8c78-7128703088aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a3d871-7659-456c-a85c-cbab5ced4aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:11 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume 42bab5df-db01-40db-9e28-f6a192356091: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42bab5df-db01-40db-9e28-f6a192356091', 'volume_size': 1} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Flow 'volume_create_manager' (30f615cf-6943-4023-a732-e241eed0b1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23422553-906f-4be3-bad7-c8847acf59ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23422553-906f-4be3-bad7-c8847acf59ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-188216735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873cc7a6-030e-4db2-9e07-68087c990923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6302eb594bd0448a8417c8612901d214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:12Z,use_quota=True,user_id='c943115ac4204732b425727069ec1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef66766-f397-4a5b-a2e8-5927f6f3a86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef66766-f397-4a5b-a2e8-5927f6f3a86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf3240b-5e59-44f1-b759-8865217be3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf3240b-5e59-44f1-b759-8865217be3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '873cc7a6-030e-4db2-9e07-68087c990923', 'volume_name': 'volume-873cc7a6-030e-4db2-9e07-68087c990923', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c86ff7e-e709-4043-ae4c-0ea019108171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c86ff7e-e709-4043-ae4c-0ea019108171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b5f615-cdc9-4c7d-bc9a-d3eae01b9793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:11 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume 873cc7a6-030e-4db2-9e07-68087c990923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-873cc7a6-030e-4db2-9e07-68087c990923', 'volume_size': 1} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-64eb3fb3-9ccc-4c46-af01-00cef0352575 1073741824" returned: 0 in 1.528s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:11 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-64eb3fb3-9ccc-4c46-af01-00cef0352575 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:12 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-64eb3fb3-9ccc-4c46-af01-00cef0352575 Jul 06 12:35:12 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:12 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:35:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Flow 'volume_create_manager' (b50d780b-5724-4ff3-97be-89a9a6fee405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b78a62b-2560-4fb8-b15d-a4e6be2f33f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b78a62b-2560-4fb8-b15d-a4e6be2f33f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-8287682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f959b311-cc0a-42d5-87e3-fdbbec36fca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6302eb594bd0448a8417c8612901d214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:12Z,use_quota=True,user_id='c943115ac4204732b425727069ec1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a19d316-7697-48fe-a709-70466a71aaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a19d316-7697-48fe-a709-70466a71aaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e94adff-4f24-4018-90e9-d3927196e1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e94adff-4f24-4018-90e9-d3927196e1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f959b311-cc0a-42d5-87e3-fdbbec36fca6', 'volume_name': 'volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf4b6de-8d93-436a-ba65-174a73f4cc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf4b6de-8d93-436a-ba65-174a73f4cc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:12 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ca0049-e794-4753-885a-4054d2087e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:12 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume f959b311-cc0a-42d5-87e3-fdbbec36fca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6', 'volume_size': 1} Jul 06 12:35:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:35:13 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Flow 'volume_create_manager' (a7f61223-a91d-4435-a344-b313487348e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c0c443-96f5-4ce8-83a2-743ee7b58f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-64eb3fb3-9ccc-4c46-af01-00cef0352575" returned: 0 in 1.120s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] <== create_volume: return (2765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.768s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.927s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1821431180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bab5df-db01-40db-9e28-f6a192356091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6302eb594bd0448a8417c8612901d214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:11Z,use_quota=True,user_id='c943115ac4204732b425727069ec1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Creating volume 42bab5df-db01-40db-9e28-f6a192356091 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:35:13 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-42bab5df-db01-40db-9e28-f6a192356091 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c0c443-96f5-4ce8-83a2-743ee7b58f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2071558413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a2c67b-798c-4bfa-9abd-9e18e1480866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6302eb594bd0448a8417c8612901d214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:13Z,use_quota=True,user_id='c943115ac4204732b425727069ec1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb24737-0eb4-4111-a476-a90bba8858e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:13 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-42bab5df-db01-40db-9e28-f6a192356091 1073741824 Jul 06 12:35:13 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb24737-0eb4-4111-a476-a90bba8858e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2c8bf2-1fdf-443b-9036-88129830cb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2c8bf2-1fdf-443b-9036-88129830cb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a2c67b-798c-4bfa-9abd-9e18e1480866', 'volume_name': 'volume-10a2c67b-798c-4bfa-9abd-9e18e1480866', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b140aea8-e99e-49b6-9601-5c8331fe875f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b140aea8-e99e-49b6-9601-5c8331fe875f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea204c0a-37a2-454d-82e2-8a61ee42c34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:13 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume 10a2c67b-798c-4bfa-9abd-9e18e1480866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a2c67b-798c-4bfa-9abd-9e18e1480866', 'volume_size': 1} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9420b4a-5d8a-4532-87e8-c5904fd1e46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64eb3fb3-9ccc-4c46-af01-00cef0352575', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beabd301-c329-4ae1-a73d-55ad252e3d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:13 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume volume-64eb3fb3-9ccc-4c46-af01-00cef0352575 (64eb3fb3-9ccc-4c46-af01-00cef0352575): created successfully Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beabd301-c329-4ae1-a73d-55ad252e3d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Flow 'volume_create_manager' (7eb2e290-434e-4a3b-971a-e80243db97bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Flow 'volume_create_manager' (92ee9d8d-6ccc-44c3-94d2-5b62b6ecf844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631f6820-5cf0-4059-8395-5e9434a57091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:13 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-769fa122-870b-4623-b356-44b0d32d8441 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Created volume successfully. Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631f6820-5cf0-4059-8395-5e9434a57091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-389762893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9805f556-29ab-4e43-860f-305adaa0415c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881ee3cd05b44d299098eee8746165a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:13Z,use_quota=True,user_id='43ca537def844bc4b71e7b28012c1ad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937e2404-f099-49c9-8a06-33e6c8565cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937e2404-f099-49c9-8a06-33e6c8565cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cda4936-8870-41fe-810d-4db165734450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cda4936-8870-41fe-810d-4db165734450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9805f556-29ab-4e43-860f-305adaa0415c', 'volume_name': 'volume-9805f556-29ab-4e43-860f-305adaa0415c', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453c6555-bf61-4f83-9054-63950cb9f38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453c6555-bf61-4f83-9054-63950cb9f38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8036828-66d1-4f8f-9af9-51015a54ee95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:13 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Volume 9805f556-29ab-4e43-860f-305adaa0415c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9805f556-29ab-4e43-860f-305adaa0415c', 'volume_size': 1} Jul 06 12:35:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:14 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-42bab5df-db01-40db-9e28-f6a192356091 1073741824" returned: 0 in 1.240s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-42bab5df-db01-40db-9e28-f6a192356091 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:14 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-42bab5df-db01-40db-9e28-f6a192356091 Jul 06 12:35:14 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:15 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-42bab5df-db01-40db-9e28-f6a192356091" returned: 0 in 0.739s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.380s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-188216735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873cc7a6-030e-4db2-9e07-68087c990923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6302eb594bd0448a8417c8612901d214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:12Z,use_quota=True,user_id='c943115ac4204732b425727069ec1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Creating volume 873cc7a6-030e-4db2-9e07-68087c990923 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:35:15 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-873cc7a6-030e-4db2-9e07-68087c990923 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a3d871-7659-456c-a85c-cbab5ced4aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42bab5df-db01-40db-9e28-f6a192356091', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:15 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-873cc7a6-030e-4db2-9e07-68087c990923 1073741824 Jul 06 12:35:15 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1afcf1-c278-4064-a986-130db725d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:15 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume volume-42bab5df-db01-40db-9e28-f6a192356091 (42bab5df-db01-40db-9e28-f6a192356091): created successfully Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1afcf1-c278-4064-a986-130db725d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Flow 'volume_create_manager' (96fba043-b9b4-428c-bf72-50346529eccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:15 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b229f661-3002-4a00-a18b-41696f8b646a tempest-CreateVolumesFromSnapshotTest-1149878234 None] Created volume successfully. Jul 06 12:35:16 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:35:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Flow 'volume_create_manager' (44971390-4982-4a86-ad9a-d2805fd4b1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e316b819-5636-4d77-a1aa-ab5b3d2b6463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e316b819-5636-4d77-a1aa-ab5b3d2b6463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1041027336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521ba021-6239-48a7-a3ef-f7ca691b6574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3566d5a2a3da43418e6be33bad71c7e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:16Z,use_quota=True,user_id='0cb633f60616402d986074f37139182d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:16 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fced89f-8d22-42f2-b3a5-c61174b4c918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fced89f-8d22-42f2-b3a5-c61174b4c918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d29c68-f00d-445b-ac6b-122c19a782c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d29c68-f00d-445b-ac6b-122c19a782c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '521ba021-6239-48a7-a3ef-f7ca691b6574', 'volume_name': 'volume-521ba021-6239-48a7-a3ef-f7ca691b6574', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9490ed8-e2be-4f58-9b5e-e72ca5b9a0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9490ed8-e2be-4f58-9b5e-e72ca5b9a0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:16 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2777c721-0c55-44a0-a93d-45b196795526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:16 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Volume 521ba021-6239-48a7-a3ef-f7ca691b6574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-521ba021-6239-48a7-a3ef-f7ca691b6574', 'volume_size': 1} Jul 06 12:35:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-873cc7a6-030e-4db2-9e07-68087c990923 1073741824" returned: 0 in 1.147s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-873cc7a6-030e-4db2-9e07-68087c990923 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:16 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-873cc7a6-030e-4db2-9e07-68087c990923 Jul 06 12:35:16 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:17 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-873cc7a6-030e-4db2-9e07-68087c990923" returned: 0 in 0.756s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.777s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-8287682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f959b311-cc0a-42d5-87e3-fdbbec36fca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6302eb594bd0448a8417c8612901d214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:12Z,use_quota=True,user_id='c943115ac4204732b425727069ec1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Creating volume f959b311-cc0a-42d5-87e3-fdbbec36fca6 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:35:17 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:17 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6 1073741824 Jul 06 12:35:17 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b5f615-cdc9-4c7d-bc9a-d3eae01b9793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-873cc7a6-030e-4db2-9e07-68087c990923', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90884ad-857c-42c0-93dc-547b507a4397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:17 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume volume-873cc7a6-030e-4db2-9e07-68087c990923 (873cc7a6-030e-4db2-9e07-68087c990923): created successfully Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90884ad-857c-42c0-93dc-547b507a4397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Flow 'volume_create_manager' (30f615cf-6943-4023-a732-e241eed0b1f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:17 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-fc56c5e8-f358-4f14-b2d8-fe80f0e16aa2 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Created volume successfully. Jul 06 12:35:18 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6 1073741824" returned: 0 in 1.041s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:18 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6 Jul 06 12:35:18 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:18 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:35:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Flow 'volume_create_manager' (277f57e9-8c77-42de-9726-4d1fd5d12fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e271da-1142-4feb-aa18-1fadb2f271ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e271da-1142-4feb-aa18-1fadb2f271ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b022fd-9444-47f6-8790-ce238c92ad18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff28b936b15428b9715f90fbc8aefc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:19Z,use_quota=True,user_id='878d56736a0b4eb7bb1184df3ab828af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa57eaac-1473-4839-81e6-47b0b2001d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa57eaac-1473-4839-81e6-47b0b2001d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b51e184-417a-4192-9484-bf5a45e26e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:18 devstack cinder-volume[86761]: DEBUG cinder.image.glance [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Creating Keystone auth plugin from conf {{(pid=86761) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:35:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b51e184-417a-4192-9484-bf5a45e26e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '21b022fd-9444-47f6-8790-ce238c92ad18', 'volume_name': 'volume-21b022fd-9444-47f6-8790-ce238c92ad18', 'volume_size': 1, 'image_id': '8fcd47c6-200c-4557-8cfe-538edd5d74cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8fcd47c6-200c-4557-8cfe-538edd5d74cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '92c86bf9616deb2f48f63c235f5b12c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3ff28b936b15428b9715f90fbc8aefc4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '44fac0abf7bf984ab619b2cb378741278c966f3be5472108ab786e04081540ae2e82947855b36452f6df96a1f3a43eda87ca13c8e90ccb5a363c42a51c93d0a4', 'id': '8fcd47c6-200c-4557-8cfe-538edd5d74cf', 'created_at': datetime.datetime(2026, 7, 6, 10, 35, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 35, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8fcd47c6-200c-4557-8cfe-538edd5d74cf/file', 'properties': {}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa5fdd8-f470-433f-ac7d-b56935bbb2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa5fdd8-f470-433f-ac7d-b56935bbb2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb44ed59-c53f-41c0-814f-4c499dd29baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:19 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Volume 21b022fd-9444-47f6-8790-ce238c92ad18: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-21b022fd-9444-47f6-8790-ce238c92ad18', 'volume_size': 1, 'image_id': '8fcd47c6-200c-4557-8cfe-538edd5d74cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8fcd47c6-200c-4557-8cfe-538edd5d74cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '92c86bf9616deb2f48f63c235f5b12c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3ff28b936b15428b9715f90fbc8aefc4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '44fac0abf7bf984ab619b2cb378741278c966f3be5472108ab786e04081540ae2e82947855b36452f6df96a1f3a43eda87ca13c8e90ccb5a363c42a51c93d0a4', 'id': '8fcd47c6-200c-4557-8cfe-538edd5d74cf', 'created_at': datetime.datetime(2026, 7, 6, 10, 35, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 35, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8fcd47c6-200c-4557-8cfe-538edd5d74cf/file', 'properties': {}}, 'image_service': } Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Trying to clone 21b022fd-9444-47f6-8790-ce238c92ad18 from image 8fcd47c6-200c-4557-8cfe-538edd5d74cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/8fcd47c6-200c-4557-8cfe-538edd5d74cf', 'metadata': {}}]). {{(pid=86761) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:35:19 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6" returned: 0 in 0.720s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.694s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2071558413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a2c67b-798c-4bfa-9abd-9e18e1480866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6302eb594bd0448a8417c8612901d214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:13Z,use_quota=True,user_id='c943115ac4204732b425727069ec1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Creating volume 10a2c67b-798c-4bfa-9abd-9e18e1480866 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:35:19 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-10a2c67b-798c-4bfa-9abd-9e18e1480866 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:19 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-10a2c67b-798c-4bfa-9abd-9e18e1480866 1073741824 Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ca0049-e794-4753-885a-4054d2087e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:19 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b130bb60-8090-48c1-b568-263fb6258591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:19 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6 (f959b311-cc0a-42d5-87e3-fdbbec36fca6): created successfully Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b130bb60-8090-48c1-b568-263fb6258591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Flow 'volume_create_manager' (b50d780b-5724-4ff3-97be-89a9a6fee405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:19 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-96072793-cbe5-444b-8a3b-8ad92edd1092 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Created volume successfully. Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:35:19 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Image download 0.00 MB at 0.00 MB/s Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[064c95ab-e845-4ee5-bde8-567ef6b6c21f]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:19 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD Jul 06 12:35:19 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:20 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:20 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD" returned: 0 in 0.791s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-10a2c67b-798c-4bfa-9abd-9e18e1480866 1073741824" returned: 0 in 1.058s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-10a2c67b-798c-4bfa-9abd-9e18e1480866 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:20 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-10a2c67b-798c-4bfa-9abd-9e18e1480866 Jul 06 12:35:20 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:20 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD Jul 06 12:35:20 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:20 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-10a2c67b-798c-4bfa-9abd-9e18e1480866" returned: 0 in 0.705s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.276s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-389762893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9805f556-29ab-4e43-860f-305adaa0415c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881ee3cd05b44d299098eee8746165a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:13Z,use_quota=True,user_id='43ca537def844bc4b71e7b28012c1ad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Creating volume 9805f556-29ab-4e43-860f-305adaa0415c {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:35:20 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:20 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c 1073741824 Jul 06 12:35:20 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea204c0a-37a2-454d-82e2-8a61ee42c34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a2c67b-798c-4bfa-9abd-9e18e1480866', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:20 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286a15bf-9e37-442c-8d56-9386d8b30fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD" returned: 1 in 0.847s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Temporary image 8fcd47c6-200c-4557-8cfe-538edd5d74cf is fetched for user 878d56736a0b4eb7bb1184df3ab828af. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:35:20 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Volume volume-10a2c67b-798c-4bfa-9abd-9e18e1480866 (10a2c67b-798c-4bfa-9abd-9e18e1480866): created successfully Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286a15bf-9e37-442c-8d56-9386d8b30fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Flow 'volume_create_manager' (a7f61223-a91d-4435-a344-b313487348e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:20 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-84f89bc2-d7a0-44ee-bb42-8274e6e2e59f tempest-CreateVolumesFromSnapshotTest-1149878234 None] Created volume successfully. Jul 06 12:35:21 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc959a5-18b6-46b3-84ca-8aa96f2c947a]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:21 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD Jul 06 12:35:21 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:21 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:21 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c 1073741824" returned: 0 in 0.967s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:21 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD Jul 06 12:35:21 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c Jul 06 12:35:21 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:21 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "cinder-10a2c67b-798c-4bfa-9abd-9e18e1480866-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-10a2c67b-798c-4bfa-9abd-9e18e1480866-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "cinder-quobyte-10a2c67b-798c-4bfa-9abd-9e18e1480866" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-10a2c67b-798c-4bfa-9abd-9e18e1480866" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a9a320-961e-4d4b-9620-20c87ce3a9c0]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-10a2c67b-798c-4bfa-9abd-9e18e1480866 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:22 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-10a2c67b-798c-4bfa-9abd-9e18e1480866 Jul 06 12:35:22 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:22 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD" returned: 1 in 0.828s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:22 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c" returned: 0 in 0.807s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.297s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1041027336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521ba021-6239-48a7-a3ef-f7ca691b6574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3566d5a2a3da43418e6be33bad71c7e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:16Z,use_quota=True,user_id='0cb633f60616402d986074f37139182d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Creating volume 521ba021-6239-48a7-a3ef-f7ca691b6574 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:35:22 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=109,cinder:UPDATE=163,cinder:INSERT=36,cinder:DELETE=16 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:35:22 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 1073741824 Jul 06 12:35:22 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8036828-66d1-4f8f-9af9-51015a54ee95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9805f556-29ab-4e43-860f-305adaa0415c', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9caf5a29-e33f-4e53-92cf-f2ad7c8a25cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:22 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Volume volume-9805f556-29ab-4e43-860f-305adaa0415c (9805f556-29ab-4e43-860f-305adaa0415c): created successfully Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9caf5a29-e33f-4e53-92cf-f2ad7c8a25cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Flow 'volume_create_manager' (92ee9d8d-6ccc-44c3-94d2-5b62b6ecf844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:22 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-db01ac7f-293a-415a-9ca4-fac014fd056c tempest-SnapshotDependencyTests-1150986826 None] Created volume successfully. Jul 06 12:35:22 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-10a2c67b-798c-4bfa-9abd-9e18e1480866" returned: 0 in 0.830s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-10a2c67b-798c-4bfa-9abd-9e18e1480866 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:23 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-10a2c67b-798c-4bfa-9abd-9e18e1480866 Jul 06 12:35:23 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:23 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=115,cinder:UPDATE=152,cinder:INSERT=43,cinder:DELETE=16 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:35:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:23 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 1073741824" returned: 0 in 1.000s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:23 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 Jul 06 12:35:23 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:23 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-10a2c67b-798c-4bfa-9abd-9e18e1480866" returned: 0 in 0.792s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:23 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-10a2c67b-798c-4bfa-9abd-9e18e1480866" released by "delete_volume" :: held 1.672s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:23 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Created reservations ['906e4003-5a0a-4a22-a113-ddc51f16a746', '0f708e65-2273-46a2-9872-9c4e8f2da813', '227c6e67-a40d-4c9a-a8c4-0ce92ac01eea', 'f2c7c36e-10eb-48fb-ac41-2c55fb954e8e'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:35:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:23 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:35:23 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "cinder-f959b311-cc0a-42d5-87e3-fdbbec36fca6-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-f959b311-cc0a-42d5-87e3-fdbbec36fca6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "cinder-quobyte-f959b311-cc0a-42d5-87e3-fdbbec36fca6" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-f959b311-cc0a-42d5-87e3-fdbbec36fca6" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:24 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574" returned: 0 in 0.727s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.848s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b022fd-9444-47f6-8790-ce238c92ad18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff28b936b15428b9715f90fbc8aefc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:19Z,use_quota=True,user_id='878d56736a0b4eb7bb1184df3ab828af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Creating volume 21b022fd-9444-47f6-8790-ce238c92ad18 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:35:24 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6f5a23-7f60-4fb2-8b8f-6632a3d293bc]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:24 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 1073741824 Jul 06 12:35:24 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2777c721-0c55-44a0-a93d-45b196795526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-521ba021-6239-48a7-a3ef-f7ca691b6574', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa69d63-f7ba-4ccc-b2e0-ecfffdfb4ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:24 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Volume volume-521ba021-6239-48a7-a3ef-f7ca691b6574 (521ba021-6239-48a7-a3ef-f7ca691b6574): created successfully Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa69d63-f7ba-4ccc-b2e0-ecfffdfb4ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Flow 'volume_create_manager' (44971390-4982-4a86-ad9a-d2805fd4b1dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:24 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7b8f7b79-851b-4aa5-8e77-1a989b00d875 tempest-VolumeDependencyTests-1333793962 None] Created volume successfully. Jul 06 12:35:24 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6 Jul 06 12:35:24 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:24 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.881s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:35:24 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Deleted volume successfully. Jul 06 12:35:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-184b51b0-a508-4680-b958-e1f31219b777 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-10a2c67b-798c-4bfa-9abd-9e18e1480866-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:25 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6" returned: 0 in 1.021s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:25 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 1073741824" returned: 0 in 1.050s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:25 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6 Jul 06 12:35:25 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:25 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 Jul 06 12:35:25 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:26 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f959b311-cc0a-42d5-87e3-fdbbec36fca6" returned: 0 in 0.705s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-f959b311-cc0a-42d5-87e3-fdbbec36fca6" released by "delete_volume" :: held 1.790s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:26 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18" returned: 0 in 0.707s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.783s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Created reservations ['adbb87c5-5f48-424a-aa2c-60ca37a31d52', 'b2f9f7ef-0ca0-4251-967f-c33d5a0f4882', '58784eb1-7e40-4fe6-b302-d9a0015cc776', '4d622d32-317c-4bec-94be-3b941737d723'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] Creating offline snapshot 65b0fc4d-adda-4b6f-a3e2-83295f95e091 of volume 9805f556-29ab-4e43-860f-305adaa0415c {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7944d139-bc93-4e22-b9fb-2d8abded9979]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Attempting download of 8fcd47c6-200c-4557-8cfe-538edd5d74cf ((None, [{'url': 'file:///opt/stack/data/glance/images/8fcd47c6-200c-4557-8cfe-538edd5d74cf', 'metadata': {}}])) to volume 21b022fd-9444-47f6-8790-ce238c92ad18. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4935889-e0cf-4a7e-9f5f-257ce15e1fd5]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8fcd47c6-200c-4557-8cfe-538edd5d74cf_pnwihkf0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:26 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:35:26 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:26 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c Jul 06 12:35:26 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:26 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8fcd47c6-200c-4557-8cfe-538edd5d74cf_pnwihkf0 Jul 06 12:35:26 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "cinder-873cc7a6-030e-4db2-9e07-68087c990923-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-873cc7a6-030e-4db2-9e07-68087c990923-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "cinder-quobyte-873cc7a6-030e-4db2-9e07-68087c990923" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-873cc7a6-030e-4db2-9e07-68087c990923" acquired by "delete_volume" :: waited 0.042s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[606cc5d4-7035-41fa-a4a0-fd36fa2d5880]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-873cc7a6-030e-4db2-9e07-68087c990923 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:26 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-873cc7a6-030e-4db2-9e07-68087c990923 Jul 06 12:35:26 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:27 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c" returned: 0 in 0.905s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:27 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.831s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:27 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:35:27 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Deleted volume successfully. Jul 06 12:35:27 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 1G Jul 06 12:35:27 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-defdec69-07ba-459f-9af4-a7993af9473b tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-f959b311-cc0a-42d5-87e3-fdbbec36fca6-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:27 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8fcd47c6-200c-4557-8cfe-538edd5d74cf_pnwihkf0" returned: 0 in 1.073s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8fcd47c6-200c-4557-8cfe-538edd5d74cf_pnwihkf0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:27 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8fcd47c6-200c-4557-8cfe-538edd5d74cf_pnwihkf0 Jul 06 12:35:27 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:27 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-873cc7a6-030e-4db2-9e07-68087c990923" returned: 0 in 0.898s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-873cc7a6-030e-4db2-9e07-68087c990923 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:27 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-873cc7a6-030e-4db2-9e07-68087c990923 Jul 06 12:35:27 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:28 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 1G" returned: 0 in 0.901s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9805f556-29ab-4e43-860f-305adaa0415c -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:28 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9805f556-29ab-4e43-860f-305adaa0415c -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 Jul 06 12:35:28 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:28 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8fcd47c6-200c-4557-8cfe-538edd5d74cf_pnwihkf0" returned: 1 in 0.936s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8fcd47c6-200c-4557-8cfe-538edd5d74cf_pnwihkf0' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fc58bf-f084-4609-8fe4-6358db828957]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:28 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-873cc7a6-030e-4db2-9e07-68087c990923" returned: 0 in 0.750s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-873cc7a6-030e-4db2-9e07-68087c990923" released by "delete_volume" :: held 1.708s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Created reservations ['2eef47b9-c04f-4a8c-bce9-c79570ab1c3f', 'cf18414c-1c43-4f79-9354-e1448f89b3e7', '71a7d01e-9a62-455d-bab7-cf4d1e213e57', 'e4b7e1b8-5b9a-4bd1-9e03-5e2b7330690d'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:35:28 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD Jul 06 12:35:28 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:28 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:35:28 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:28 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9805f556-29ab-4e43-860f-305adaa0415c -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091" returned: 0 in 0.802s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:28 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 is being set with open permissions: ugo+rw Jul 06 12:35:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:29 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 Jul 06 12:35:29 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "cinder-42bab5df-db01-40db-9e28-f6a192356091-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-42bab5df-db01-40db-9e28-f6a192356091-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "cinder-quobyte-42bab5df-db01-40db-9e28-f6a192356091" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-42bab5df-db01-40db-9e28-f6a192356091" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:29 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fc13e1-df8c-4dd5-8044-84d44dcc662a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-42bab5df-db01-40db-9e28-f6a192356091 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:29 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-42bab5df-db01-40db-9e28-f6a192356091 Jul 06 12:35:29 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:29 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD" returned: 0 in 0.917s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:29 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.861s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:29 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:35:29 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD Jul 06 12:35:29 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:29 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Deleted volume successfully. Jul 06 12:35:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4be0aa9f-4918-4a71-8b13-756af5c85a5c tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-873cc7a6-030e-4db2-9e07-68087c990923-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:29 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091" returned: 0 in 0.806s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:29 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.info Jul 06 12:35:29 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:30 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-42bab5df-db01-40db-9e28-f6a192356091" returned: 0 in 0.921s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-42bab5df-db01-40db-9e28-f6a192356091 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:30 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-42bab5df-db01-40db-9e28-f6a192356091 Jul 06 12:35:30 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:30 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD" returned: 1 in 0.904s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] 8fcd47c6-200c-4557-8cfe-538edd5d74cf was raw, converting to raw {{(pid=86761) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:30 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 Jul 06 12:35:30 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:30 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.info" returned: 0 in 0.742s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:30 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.info is being set with open permissions: ugo+rw Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:30 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.info Jul 06 12:35:30 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:30 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-42bab5df-db01-40db-9e28-f6a192356091" returned: 0 in 0.682s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-42bab5df-db01-40db-9e28-f6a192356091" released by "delete_volume" :: held 1.666s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Created reservations ['cf95cf12-5394-46dc-8ddd-51c691db924b', '6603f211-c9d9-4c3d-9acc-94860f210bf6', 'd4081000-3fa1-4676-9036-f063fc43e7c4', 'd9887db6-eff1-4260-9cca-ab0f28d77f92'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:30 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:35:30 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:31 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18" returned: 0 in 0.777s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8fcd47c6-200c-4557-8cfe-538edd5d74cf_30rj4hdddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:35:31 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:31 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 1G Jul 06 12:35:31 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:31 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.info" returned: 0 in 0.682s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.942s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.222s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] Creating offline snapshot 55d05c61-8961-453d-be2d-4c6708c004b3 of volume 521ba021-6239-48a7-a3ef-f7ca691b6574 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ac6cce-dca6-4921-a7ab-bd08f0a51017]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "cinder-64eb3fb3-9ccc-4c46-af01-00cef0352575-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:31 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d7f49818-4ded-4678-8ad6-a00acda5ceff tempest-SnapshotDependencyTests-1150986826 None] Create snapshot completed successfully Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-64eb3fb3-9ccc-4c46-af01-00cef0352575-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "cinder-quobyte-64eb3fb3-9ccc-4c46-af01-00cef0352575" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-64eb3fb3-9ccc-4c46-af01-00cef0352575" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c9201f-25b2-4e1a-9113-0ecc8f2ed6c3]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-64eb3fb3-9ccc-4c46-af01-00cef0352575 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:31 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 Jul 06 12:35:31 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:31 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-64eb3fb3-9ccc-4c46-af01-00cef0352575 Jul 06 12:35:31 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:31 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.827s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:35:31 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Deleted volume successfully. Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-250eb959-fbb7-4339-ab6f-c81ea0ee3f07 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-42bab5df-db01-40db-9e28-f6a192356091-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:31 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 1G" returned: 0 in 0.820s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4ff5b7-8ffc-4678-9ec5-b04598d26643]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:32 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 Jul 06 12:35:32 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:32 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574" returned: 0 in 0.984s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:32 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 1G Jul 06 12:35:32 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:32 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-64eb3fb3-9ccc-4c46-af01-00cef0352575" returned: 0 in 0.994s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-64eb3fb3-9ccc-4c46-af01-00cef0352575 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:32 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-64eb3fb3-9ccc-4c46-af01-00cef0352575 Jul 06 12:35:32 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Flow 'volume_create_manager' (4d78bf0c-f240-4cf2-955b-fecd9f0ab735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc1d398-0229-44a8-ad6d-18a2889e4d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc1d398-0229-44a8-ad6d-18a2889e4d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8959d645-8639-49ac-b7ed-3ee3d15cc999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881ee3cd05b44d299098eee8746165a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=65b0fc4d-adda-4b6f-a3e2-83295f95e091,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:33Z,use_quota=True,user_id='43ca537def844bc4b71e7b28012c1ad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51445f24-c440-445d-892b-713bee2a0875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51445f24-c440-445d-892b-713bee2a0875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fb794c-7ad2-482c-bc16-34896dafd781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fb794c-7ad2-482c-bc16-34896dafd781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8959d645-8639-49ac-b7ed-3ee3d15cc999', 'volume_name': 'volume-8959d645-8639-49ac-b7ed-3ee3d15cc999', 'volume_size': 1, 'snapshot_id': '65b0fc4d-adda-4b6f-a3e2-83295f95e091'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5967d29-a2d1-4d07-b86a-5b72a664f721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5967d29-a2d1-4d07-b86a-5b72a664f721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ccb806-2746-499a-97ec-276af3889a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:32 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Volume 8959d645-8639-49ac-b7ed-3ee3d15cc999: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8959d645-8639-49ac-b7ed-3ee3d15cc999', 'volume_size': 1, 'snapshot_id': '65b0fc4d-adda-4b6f-a3e2-83295f95e091'} Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:32 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18" returned: 0 in 0.961s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:33 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 Jul 06 12:35:33 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:33 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 1G" returned: 0 in 0.903s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-521ba021-6239-48a7-a3ef-f7ca691b6574 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:33 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-521ba021-6239-48a7-a3ef-f7ca691b6574 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 Jul 06 12:35:33 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:33 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-64eb3fb3-9ccc-4c46-af01-00cef0352575" returned: 0 in 0.838s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-64eb3fb3-9ccc-4c46-af01-00cef0352575" released by "delete_volume" :: held 1.888s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Created reservations ['23cacb8f-7d44-4c7d-901b-2592ab90253d', '17ec6ca1-729f-45ab-839b-f4b0340df6b1', '96cdab68-735e-4819-b8d5-5e1fc20851bf', 'f36d59ec-163f-4de2-8895-38cbd4f5367d'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:33 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:35:33 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "cinder-c99cdc52-f52e-42f6-a6ec-edfe686b00d0-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-c99cdc52-f52e-42f6-a6ec-edfe686b00d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "cinder-quobyte-5e9a8017-b92c-4b9c-b640-36f423999350" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-5e9a8017-b92c-4b9c-b640-36f423999350" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "cinder-quobyte-c99cdc52-f52e-42f6-a6ec-edfe686b00d0" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-c99cdc52-f52e-42f6-a6ec-edfe686b00d0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Deleting offline snapshot c99cdc52-f52e-42f6-a6ec-edfe686b00d0 of volume 5e9a8017-b92c-4b9c-b640-36f423999350 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] snapshot_file for this snap is: volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:35:33 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18" returned: 1 in 0.910s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Downloaded image 8fcd47c6-200c-4557-8cfe-538edd5d74cf ((None, [{'url': 'file:///opt/stack/data/glance/images/8fcd47c6-200c-4557-8cfe-538edd5d74cf', 'metadata': {}}])) to volume 21b022fd-9444-47f6-8790-ce238c92ad18 successfully. {{(pid=86761) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Temporary image 8fcd47c6-200c-4557-8cfe-538edd5d74cf for user 878d56736a0b4eb7bb1184df3ab828af is deleted. {{(pid=86761) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.volume.volume_utils [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Marking volume 21b022fd-9444-47f6-8790-ce238c92ad18 as bootable. {{(pid=86761) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[a165008f-c6f4-4263-8044-a8ac147dd401]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Copying metadata from image 8fcd47c6-200c-4557-8cfe-538edd5d74cf to 21b022fd-9444-47f6-8790-ce238c92ad18. {{(pid=86761) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Creating volume glance metadata for volume 21b022fd-9444-47f6-8790-ce238c92ad18 backed by image 8fcd47c6-200c-4557-8cfe-538edd5d74cf with: {'image_id': '8fcd47c6-200c-4557-8cfe-538edd5d74cf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '92c86bf9616deb2f48f63c235f5b12c9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86761) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb44ed59-c53f-41c0-814f-4c499dd29baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b022fd-9444-47f6-8790-ce238c92ad18', 'volume_size': 1, 'image_id': '8fcd47c6-200c-4557-8cfe-538edd5d74cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8fcd47c6-200c-4557-8cfe-538edd5d74cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '92c86bf9616deb2f48f63c235f5b12c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3ff28b936b15428b9715f90fbc8aefc4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '44fac0abf7bf984ab619b2cb378741278c966f3be5472108ab786e04081540ae2e82947855b36452f6df96a1f3a43eda87ca13c8e90ccb5a363c42a51c93d0a4', 'id': '8fcd47c6-200c-4557-8cfe-538edd5d74cf', 'created_at': datetime.datetime(2026, 7, 6, 10, 35, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 35, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8fcd47c6-200c-4557-8cfe-538edd5d74cf/file', 'properties': {}}, 'image_service': }' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdb4213-d229-48df-95ac-010fd671ac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:33 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0 Jul 06 12:35:33 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:33 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Volume volume-21b022fd-9444-47f6-8790-ce238c92ad18 (21b022fd-9444-47f6-8790-ce238c92ad18): created successfully Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdb4213-d229-48df-95ac-010fd671ac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Flow 'volume_create_manager' (277f57e9-8c77-42de-9726-4d1fd5d12fe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:33 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-3f63684b-f8b3-4899-bdb5-af6e6796684a tempest-VolumeImageDependencyTests-1078457426 None] Created volume successfully. Jul 06 12:35:34 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-521ba021-6239-48a7-a3ef-f7ca691b6574 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3" returned: 0 in 0.930s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:34 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 is being set with open permissions: ugo+rw Jul 06 12:35:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:34 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 Jul 06 12:35:34 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:34 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.824s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:34 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:35:34 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Deleted volume successfully. Jul 06 12:35:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4c6dc651-76e8-4199-9ad4-f0dc6b9e1486 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-64eb3fb3-9ccc-4c46-af01-00cef0352575-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:34 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0" returned: 0 in 0.893s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:34 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e9a8017-b92c-4b9c-b640-36f423999350(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:35:34 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c90185-6bea-4fa3-b5de-71761d092174]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:34 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3" returned: 0 in 0.726s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:34 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350 Jul 06 12:35:34 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:34 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.info Jul 06 12:35:34 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Acquiring lock "cinder-21b022fd-9444-47f6-8790-ce238c92ad18-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:34 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Lock "cinder-21b022fd-9444-47f6-8790-ce238c92ad18-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Acquiring lock "cinder-quobyte-21b022fd-9444-47f6-8790-ce238c92ad18" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Lock "cinder-quobyte-21b022fd-9444-47f6-8790-ce238c92ad18" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:35 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3e0bb9-91a2-48df-bde7-4d51794e1df1]: (4, 'raw') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:35 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 Jul 06 12:35:35 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:35 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.info" returned: 0 in 0.702s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:35 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.info is being set with open permissions: ugo+rw Jul 06 12:35:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:35 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.info Jul 06 12:35:35 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:35 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350" returned: 0 in 0.931s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:35 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0 Jul 06 12:35:35 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:35 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18" returned: 0 in 0.851s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:36 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 Jul 06 12:35:36 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:36 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.info" returned: 0 in 0.757s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.128s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.504s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "cinder-quobyte-65b0fc4d-adda-4b6f-a3e2-83295f95e091-8959d645-8639-49ac-b7ed-3ee3d15cc999" by "_create_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-quobyte-65b0fc4d-adda-4b6f-a3e2-83295f95e091-8959d645-8639-49ac-b7ed-3ee3d15cc999" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Creating volume 8959d645-8639-49ac-b7ed-3ee3d15cc999 from snapshot 65b0fc4d-adda-4b6f-a3e2-83295f95e091 {{(pid=86761) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "cinder-quobyte-8959d645-8639-49ac-b7ed-3ee3d15cc999" by "_copy_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:36 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-1c3d6986-58ce-4046-8626-686ea1005c6d tempest-VolumeDependencyTests-1333793962 None] Create snapshot completed successfully Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-quobyte-8959d645-8639-49ac-b7ed-3ee3d15cc999" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] snapshot: 65b0fc4d-adda-4b6f-a3e2-83295f95e091, volume: 8959d645-8639-49ac-b7ed-3ee3d15cc999, {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8875d7a-9cd6-4dc8-90ba-4362df1b59b6]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:36 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0" returned: 0 in 0.843s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:36 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0 Jul 06 12:35:36 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:36 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 Jul 06 12:35:36 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:36 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18" returned: 1 in 0.932s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18' failed. Not Retrying. {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:35:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:36 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18 Jul 06 12:35:36 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:35:37 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350.c99cdc52-f52e-42f6-a6ec-edfe686b00d0" returned: 0 in 0.851s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Flow 'volume_create_manager' (cd1c361e-6d22-418c-9e23-765da6a22c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09a4f09-085f-47be-a586-204854eb85d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09a4f09-085f-47be-a586-204854eb85d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2073682939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32b3c74-98db-438f-8295-9567394ad249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3566d5a2a3da43418e6be33bad71c7e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=55d05c61-8961-453d-be2d-4c6708c004b3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:37Z,use_quota=True,user_id='0cb633f60616402d986074f37139182d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddedadab-49bd-4892-b1ec-3f8d958370df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddedadab-49bd-4892-b1ec-3f8d958370df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f92a360-90e3-4bce-8dc2-e6c5c07825ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f92a360-90e3-4bce-8dc2-e6c5c07825ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a32b3c74-98db-438f-8295-9567394ad249', 'volume_name': 'volume-a32b3c74-98db-438f-8295-9567394ad249', 'volume_size': 1, 'snapshot_id': '55d05c61-8961-453d-be2d-4c6708c004b3'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae75e062-5265-4194-9767-b5a718ace6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae75e062-5265-4194-9767-b5a718ace6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d8d5e9e-cbc7-4dca-890a-440da21de54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:37 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Volume a32b3c74-98db-438f-8295-9567394ad249: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a32b3c74-98db-438f-8295-9567394ad249', 'volume_size': 1, 'snapshot_id': '55d05c61-8961-453d-be2d-4c6708c004b3'} Jul 06 12:35:37 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-c99cdc52-f52e-42f6-a6ec-edfe686b00d0" released by "_delete_snapshot" :: held 3.747s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091" returned: 0 in 1.003s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9805f556-29ab-4e43-860f-305adaa0415c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Creating direct copy from snapshot {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-5e9a8017-b92c-4b9c-b640-36f423999350" released by "delete_snapshot" :: held 3.783s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c36eda-2017-4809-9edd-f57d045941dc]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Created reservations ['a80a761f-d7e4-464f-8a41-b165547b7e6e', 'a3164660-8a98-40b0-ba1a-ffdb43a38d61', 'a8dc54f0-676e-486d-b8ca-6353273a2f4e', 'd9804de3-1286-4837-a755-c8cd6dab547e'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:35:37 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Delete snapshot completed successfully. Jul 06 12:35:37 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c Jul 06 12:35:37 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f9abd3d8-e1b5-40e0-ad01-d0496ed24a29 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-c99cdc52-f52e-42f6-a6ec-edfe686b00d0-delete_snapshot" released by "delete_snapshot" :: held 3.948s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:37 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-21b022fd-9444-47f6-8790-ce238c92ad18" returned: 0 in 0.856s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Lock "cinder-quobyte-21b022fd-9444-47f6-8790-ce238c92ad18" released by "delete_volume" :: held 2.712s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Created reservations ['44e2c4b0-8279-4d6f-8a72-9320f220fbfe', 'dc356308-91a5-4bd7-98a8-742e6890ab0e', 'f9e5ecf7-636a-4ec8-983e-a8dc63643e1b', 'cf52c3a5-d303-46da-9431-cba1599c8b50'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:37 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:35:37 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "cinder-5e9a8017-b92c-4b9c-b640-36f423999350-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-5e9a8017-b92c-4b9c-b640-36f423999350-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "cinder-quobyte-5e9a8017-b92c-4b9c-b640-36f423999350" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-5e9a8017-b92c-4b9c-b640-36f423999350" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:38 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26fe26c-dc09-49da-9d59-32958e95a2f4]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:38 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350 Jul 06 12:35:38 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:38 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c" returned: 0 in 0.858s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:38 devstack cinder-volume[86761]: DEBUG cinder.utils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Path /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8959d645-8639-49ac-b7ed-3ee3d15cc999 not found in is_blk_device check {{(pid=86761) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:35:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8959d645-8639-49ac-b7ed-3ee3d15cc999 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:38 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8959d645-8639-49ac-b7ed-3ee3d15cc999 Jul 06 12:35:38 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:38 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.797s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:38 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:35:38 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Deleted volume successfully. Jul 06 12:35:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-81eac4e5-789f-409d-900f-bbcba878b50f tempest-VolumeImageDependencyTests-1078457426 None] Lock "cinder-21b022fd-9444-47f6-8790-ce238c92ad18-delete_volume" released by "delete_volume" :: held 3.798s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:39 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350" returned: 0 in 0.911s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:39 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350 Jul 06 12:35:39 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:40 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5e9a8017-b92c-4b9c-b640-36f423999350" returned: 0 in 1.504s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-quobyte-5e9a8017-b92c-4b9c-b640-36f423999350" released by "delete_volume" :: held 2.511s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:40 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Created reservations ['dc9e7430-afe6-40f3-b635-a06a22142e63', '32c80d08-c8a8-48c2-8872-c29be16066ff', '596f6aef-669d-4f00-a34e-af6c0da89097', '559b8ada-4d7f-4dd1-9932-d450252f7a99'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:35:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:41 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:35:41 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:42 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.567s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:42 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:35:42 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Deleted volume successfully. Jul 06 12:35:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5d3dd9b9-9b5b-4b4a-b033-3e03df2bf770 tempest-CreateVolumesFromSnapshotTest-1149878234 None] Lock "cinder-5e9a8017-b92c-4b9c-b640-36f423999350-delete_volume" released by "delete_volume" :: held 4.750s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:45 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8959d645-8639-49ac-b7ed-3ee3d15cc999" returned: 0 in 6.628s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:45 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e02a8b-2e93-4f8c-ad26-e58ce4a15c77]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:45 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c Jul 06 12:35:45 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:46 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c" returned: 0 in 1.163s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:46 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c, size 1024.00 MB, duration 6.63 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8959d645-8639-49ac-b7ed-3ee3d15cc999 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:35:46 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Converted 1024.00 MB image at 154.47 MB/s Jul 06 12:35:46 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8959d645-8639-49ac-b7ed-3ee3d15cc999 is being set with open permissions: ugo+rw Jul 06 12:35:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8959d645-8639-49ac-b7ed-3ee3d15cc999 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:46 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8959d645-8639-49ac-b7ed-3ee3d15cc999 Jul 06 12:35:46 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:46 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8959d645-8639-49ac-b7ed-3ee3d15cc999" returned: 0 in 0.736s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:46 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-quobyte-8959d645-8639-49ac-b7ed-3ee3d15cc999" released by "_copy_volume_from_snapshot" :: held 10.515s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:46 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-quobyte-65b0fc4d-adda-4b6f-a3e2-83295f95e091-8959d645-8639-49ac-b7ed-3ee3d15cc999" released by "_create_volume_from_snapshot" :: held 10.567s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.605s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.453s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:46 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "cinder-quobyte-55d05c61-8961-453d-be2d-4c6708c004b3-a32b3c74-98db-438f-8295-9567394ad249" by "_create_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-quobyte-55d05c61-8961-453d-be2d-4c6708c004b3-a32b3c74-98db-438f-8295-9567394ad249" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Creating volume a32b3c74-98db-438f-8295-9567394ad249 from snapshot 55d05c61-8961-453d-be2d-4c6708c004b3 {{(pid=86761) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "cinder-quobyte-a32b3c74-98db-438f-8295-9567394ad249" by "_copy_volume_from_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ccb806-2746-499a-97ec-276af3889a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8959d645-8639-49ac-b7ed-3ee3d15cc999', 'volume_size': 1, 'snapshot_id': '65b0fc4d-adda-4b6f-a3e2-83295f95e091'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac2561e-a200-4005-9537-0840e32168bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-quobyte-a32b3c74-98db-438f-8295-9567394ad249" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] snapshot: 55d05c61-8961-453d-be2d-4c6708c004b3, volume: a32b3c74-98db-438f-8295-9567394ad249, {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:35:47 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Volume volume-8959d645-8639-49ac-b7ed-3ee3d15cc999 (8959d645-8639-49ac-b7ed-3ee3d15cc999): created successfully Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac2561e-a200-4005-9537-0840e32168bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Flow 'volume_create_manager' (4d78bf0c-f240-4cf2-955b-fecd9f0ab735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f69d0a6-55d3-4941-9668-b462f153d79b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:47 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c4d43aed-0eb9-47fa-b942-00006ec06fe7 tempest-SnapshotDependencyTests-1150986826 None] Created volume successfully. Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Flow 'volume_create_manager' (91f77469-04cc-49b4-8bc7-c92c2ed11f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446aecaf-e594-4cdb-b076-22cb905e7bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446aecaf-e594-4cdb-b076-22cb905e7bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa894c71-b4aa-43aa-9997-1df422bba004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650c6413e5404ab6a0681a6387ab4de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:47Z,use_quota=True,user_id='45d53be4f9414a70b90cc1f437d690ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb103d8d-592f-4cc2-a4f5-358db997dbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb103d8d-592f-4cc2-a4f5-358db997dbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b0cd50-a57f-413a-8523-7dc9a8b27ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b0cd50-a57f-413a-8523-7dc9a8b27ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa894c71-b4aa-43aa-9997-1df422bba004', 'volume_name': 'volume-aa894c71-b4aa-43aa-9997-1df422bba004', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:47 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf68ca23-5ac6-4b19-ae6f-20529e03ef74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:47 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf68ca23-5ac6-4b19-ae6f-20529e03ef74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac78dcc3-bd6e-4957-804d-95c81fabf70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:47 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Volume aa894c71-b4aa-43aa-9997-1df422bba004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa894c71-b4aa-43aa-9997-1df422bba004', 'volume_size': 1} Jul 06 12:35:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:48 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3" returned: 0 in 0.980s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-521ba021-6239-48a7-a3ef-f7ca691b6574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Creating direct copy from snapshot {{(pid=86761) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[707aa079-d2e5-4298-843e-b77f94873abf]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:48 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 Jul 06 12:35:48 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "cinder-65b0fc4d-adda-4b6f-a3e2-83295f95e091-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-65b0fc4d-adda-4b6f-a3e2-83295f95e091-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "cinder-quobyte-9805f556-29ab-4e43-860f-305adaa0415c" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-quobyte-9805f556-29ab-4e43-860f-305adaa0415c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "cinder-quobyte-65b0fc4d-adda-4b6f-a3e2-83295f95e091" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-quobyte-65b0fc4d-adda-4b6f-a3e2-83295f95e091" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Deleting offline snapshot 65b0fc4d-adda-4b6f-a3e2-83295f95e091 of volume 9805f556-29ab-4e43-860f-305adaa0415c {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] snapshot_file for this snap is: volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[583ab9cb-a28b-4c8b-bf47-5303e536e41e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:48 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 Jul 06 12:35:48 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:49 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574" returned: 0 in 0.931s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:49 devstack cinder-volume[86761]: DEBUG cinder.utils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Path /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a32b3c74-98db-438f-8295-9567394ad249 not found in is_blk_device check {{(pid=86761) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:35:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a32b3c74-98db-438f-8295-9567394ad249 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:49 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a32b3c74-98db-438f-8295-9567394ad249 Jul 06 12:35:49 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:49 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091" returned: 0 in 0.925s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9805f556-29ab-4e43-860f-305adaa0415c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:35:49 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d49ca1-01b8-4f2b-a42a-56351a75f81d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:49 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c Jul 06 12:35:49 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:50 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c" returned: 0 in 1.291s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:50 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 Jul 06 12:35:50 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:35:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:52 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:35:52 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:53 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091" returned: 0 in 2.324s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:53 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091 Jul 06 12:35:53 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:54 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 2.256s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:54 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:35:54 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:35:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:35:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:35:55 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c.65b0fc4d-adda-4b6f-a3e2-83295f95e091" returned: 0 in 2.225s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-quobyte-65b0fc4d-adda-4b6f-a3e2-83295f95e091" released by "_delete_snapshot" :: held 6.949s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-quobyte-9805f556-29ab-4e43-860f-305adaa0415c" released by "delete_snapshot" :: held 6.978s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:55 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a32b3c74-98db-438f-8295-9567394ad249" returned: 0 in 6.338s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:55 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6ec0d4-dc5e-40d8-b5ee-b36ee20f149c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:55 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Created reservations ['369f4408-892b-4cea-8454-f71b02b404a6', '9e4c449b-0091-482d-9cd6-345dc13d13fe', '3f13bb77-fe39-4f2c-ada9-776538019ac9', '6257fc16-54d9-4849-9a01-05f5bd8c1b61'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:35:55 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Delete snapshot completed successfully. Jul 06 12:35:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-9bf8a51a-6d59-458e-9bc1-64ee5e8291fb tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-65b0fc4d-adda-4b6f-a3e2-83295f95e091-delete_snapshot" released by "delete_snapshot" :: held 7.203s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:55 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 Jul 06 12:35:55 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:56 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "cinder-9805f556-29ab-4e43-860f-305adaa0415c-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:56 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-9805f556-29ab-4e43-860f-305adaa0415c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:56 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "cinder-quobyte-9805f556-29ab-4e43-860f-305adaa0415c" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:56 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-quobyte-9805f556-29ab-4e43-860f-305adaa0415c" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:56 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb1bcaf-c9cd-4f46-898c-3f6a287aec62]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:56 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c Jul 06 12:35:56 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:56 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574" returned: 0 in 1.092s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:56 devstack cinder-volume[86761]: DEBUG cinder.image.image_utils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a32b3c74-98db-438f-8295-9567394ad249 {{(pid=86761) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:35:56 devstack cinder-volume[86761]: INFO cinder.image.image_utils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Converted 1024.00 MB image at 161.53 MB/s Jul 06 12:35:56 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a32b3c74-98db-438f-8295-9567394ad249 is being set with open permissions: ugo+rw Jul 06 12:35:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a32b3c74-98db-438f-8295-9567394ad249 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:56 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a32b3c74-98db-438f-8295-9567394ad249 Jul 06 12:35:56 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:57 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c" returned: 0 in 0.850s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:57 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c Jul 06 12:35:57 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:57 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a32b3c74-98db-438f-8295-9567394ad249" returned: 0 in 0.755s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-quobyte-a32b3c74-98db-438f-8295-9567394ad249" released by "_copy_volume_from_snapshot" :: held 10.278s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-quobyte-55d05c61-8961-453d-be2d-4c6708c004b3-a32b3c74-98db-438f-8295-9567394ad249" released by "_create_volume_from_snapshot" :: held 10.354s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.391s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.014s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa894c71-b4aa-43aa-9997-1df422bba004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650c6413e5404ab6a0681a6387ab4de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:35:47Z,use_quota=True,user_id='45d53be4f9414a70b90cc1f437d690ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Creating volume aa894c71-b4aa-43aa-9997-1df422bba004 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:35:57 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa894c71-b4aa-43aa-9997-1df422bba004 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:57 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa894c71-b4aa-43aa-9997-1df422bba004 1073741824 Jul 06 12:35:57 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d8d5e9e-cbc7-4dca-890a-440da21de54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a32b3c74-98db-438f-8295-9567394ad249', 'volume_size': 1, 'snapshot_id': '55d05c61-8961-453d-be2d-4c6708c004b3'}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34979f5-ec3d-4b21-a303-7a05318736a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:57 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Volume volume-a32b3c74-98db-438f-8295-9567394ad249 (a32b3c74-98db-438f-8295-9567394ad249): created successfully Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34979f5-ec3d-4b21-a303-7a05318736a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Flow 'volume_create_manager' (cd1c361e-6d22-418c-9e23-765da6a22c2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:57 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-05c38313-66c1-481d-8934-3f7696ce717f tempest-VolumeDependencyTests-1333793962 None] Created volume successfully. Jul 06 12:35:58 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9805f556-29ab-4e43-860f-305adaa0415c" returned: 0 in 0.803s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-quobyte-9805f556-29ab-4e43-860f-305adaa0415c" released by "delete_volume" :: held 1.729s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Created reservations ['9fa495a5-a321-46ac-9ac9-e86c674ee023', '3caa426f-b5cf-461a-97d7-29cdd93efada', '9aa78c90-7985-4c5b-a97d-e951449e53be', '17085043-5b1e-4abf-836f-a260892a9fe9'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:58 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:35:58 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:58 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "cinder-8959d645-8639-49ac-b7ed-3ee3d15cc999-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa894c71-b4aa-43aa-9997-1df422bba004 1073741824" returned: 0 in 1.090s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-8959d645-8639-49ac-b7ed-3ee3d15cc999-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa894c71-b4aa-43aa-9997-1df422bba004 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "cinder-quobyte-8959d645-8639-49ac-b7ed-3ee3d15cc999" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-quobyte-8959d645-8639-49ac-b7ed-3ee3d15cc999" acquired by "delete_volume" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:58 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa894c71-b4aa-43aa-9997-1df422bba004 Jul 06 12:35:58 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[759fed23-3d44-4915-8fb2-aed0d01fd40b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8959d645-8639-49ac-b7ed-3ee3d15cc999 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "cinder-55d05c61-8961-453d-be2d-4c6708c004b3-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-55d05c61-8961-453d-be2d-4c6708c004b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "cinder-quobyte-521ba021-6239-48a7-a3ef-f7ca691b6574" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-quobyte-521ba021-6239-48a7-a3ef-f7ca691b6574" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "cinder-quobyte-55d05c61-8961-453d-be2d-4c6708c004b3" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-quobyte-55d05c61-8961-453d-be2d-4c6708c004b3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Deleting offline snapshot 55d05c61-8961-453d-be2d-4c6708c004b3 of volume 521ba021-6239-48a7-a3ef-f7ca691b6574 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] snapshot_file for this snap is: volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f178ee9-aaef-43b2-83e7-54773a50d09c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:58 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8959d645-8639-49ac-b7ed-3ee3d15cc999 Jul 06 12:35:58 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:59 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.857s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:59 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:35:59 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 Jul 06 12:35:59 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:59 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Deleted volume successfully. Jul 06 12:35:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dc17c34c-a239-407a-8fd4-b39f160389d7 tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-9805f556-29ab-4e43-860f-305adaa0415c-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:35:59 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa894c71-b4aa-43aa-9997-1df422bba004" returned: 0 in 0.946s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] <== create_volume: return (2104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:35:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac78dcc3-bd6e-4957-804d-95c81fabf70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa894c71-b4aa-43aa-9997-1df422bba004', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0231a303-36bb-4bc1-a09a-e5f9123267f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:35:59 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Volume volume-aa894c71-b4aa-43aa-9997-1df422bba004 (aa894c71-b4aa-43aa-9997-1df422bba004): created successfully Jul 06 12:35:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0231a303-36bb-4bc1-a09a-e5f9123267f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:35:59 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Flow 'volume_create_manager' (91f77469-04cc-49b4-8bc7-c92c2ed11f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:35:59 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-3371640c-b825-458e-943e-84d547555077 tempest-CinderUnicodeTest-974929508 None] Created volume successfully. Jul 06 12:35:59 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8959d645-8639-49ac-b7ed-3ee3d15cc999" returned: 0 in 1.326s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8959d645-8639-49ac-b7ed-3ee3d15cc999 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:00 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8959d645-8639-49ac-b7ed-3ee3d15cc999 Jul 06 12:36:00 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:00 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3" returned: 0 in 1.237s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-521ba021-6239-48a7-a3ef-f7ca691b6574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:36:00 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b69b5b-b42e-4177-850c-ed869bf3b990]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:00 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 Jul 06 12:36:00 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:00 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-8959d645-8639-49ac-b7ed-3ee3d15cc999" returned: 0 in 0.755s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-quobyte-8959d645-8639-49ac-b7ed-3ee3d15cc999" released by "delete_volume" :: held 2.160s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:00 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Created reservations ['04bd9639-b496-4860-9702-f8517ed236c8', '406a18df-e5ed-4871-98bd-a714a13b691b', '7ff3d963-1bca-4b6c-b139-1ec64c0f322d', 'fda9b4f7-c49e-4b66-8c78-398442fed065'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:00 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:36:00 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:01 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574" returned: 0 in 0.919s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:01 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 Jul 06 12:36:01 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Flow 'volume_create_manager' (fb68d999-b5c3-48f5-ac5a-3989ac183084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cae63a-1fd6-4146-bc47-45dec1a526b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cae63a-1fd6-4146-bc47-45dec1a526b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1446656768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b49c47-0279-4032-9c44-278f07285563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650c6413e5404ab6a0681a6387ab4de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:01Z,use_quota=True,user_id='45d53be4f9414a70b90cc1f437d690ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e93bc3-c317-4a67-9da9-6ed9cabefb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e93bc3-c317-4a67-9da9-6ed9cabefb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866aadf2-b819-49af-b862-f5b70dca2f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866aadf2-b819-49af-b862-f5b70dca2f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8b49c47-0279-4032-9c44-278f07285563', 'volume_name': 'volume-f8b49c47-0279-4032-9c44-278f07285563', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73b475b-0598-4524-93f6-2d0b82522679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73b475b-0598-4524-93f6-2d0b82522679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a65e97-d171-4e1c-a028-cf6e854d59b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:01 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Volume f8b49c47-0279-4032-9c44-278f07285563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8b49c47-0279-4032-9c44-278f07285563', 'volume_size': 1} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1446656768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b49c47-0279-4032-9c44-278f07285563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650c6413e5404ab6a0681a6387ab4de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:01Z,use_quota=True,user_id='45d53be4f9414a70b90cc1f437d690ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Creating volume f8b49c47-0279-4032-9c44-278f07285563 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:01 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:01 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563 1073741824 Jul 06 12:36:01 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:01 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.788s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:01 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Deleted volume successfully. Jul 06 12:36:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-04499031-fdbe-439c-92bd-86d509c6875c tempest-SnapshotDependencyTests-1150986826 None] Lock "cinder-8959d645-8639-49ac-b7ed-3ee3d15cc999-delete_volume" released by "delete_volume" :: held 3.266s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:02 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3" returned: 0 in 1.006s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:02 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3 Jul 06 12:36:02 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:02 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563 1073741824" returned: 0 in 1.205s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:02 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563 Jul 06 12:36:02 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:02 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574.55d05c61-8961-453d-be2d-4c6708c004b3" returned: 0 in 0.859s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-quobyte-55d05c61-8961-453d-be2d-4c6708c004b3" released by "_delete_snapshot" :: held 4.228s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-quobyte-521ba021-6239-48a7-a3ef-f7ca691b6574" released by "delete_snapshot" :: held 4.272s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:03 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Created reservations ['3a2f1f5c-a30b-42f1-9f4f-e52f7c3e4b8d', 'ecf0e35a-d1b8-4c59-af3e-4b9b7bf98f0f', 'f15ccf57-6355-4426-94b8-9554de44a647', '7a0f14af-f0a3-472e-a737-4b9aed57847d'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:03 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Delete snapshot completed successfully. Jul 06 12:36:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6123d570-469c-4d73-b70b-6f728d0d37f4 tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-55d05c61-8961-453d-be2d-4c6708c004b3-delete_snapshot" released by "delete_snapshot" :: held 4.510s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:03 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563" returned: 0 in 1.079s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] <== create_volume: return (2366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:36:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.370s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a65e97-d171-4e1c-a028-cf6e854d59b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8b49c47-0279-4032-9c44-278f07285563', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c315e3a-c626-4697-9a1a-940c4d41af07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:03 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Volume volume-f8b49c47-0279-4032-9c44-278f07285563 (f8b49c47-0279-4032-9c44-278f07285563): created successfully Jul 06 12:36:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c315e3a-c626-4697-9a1a-940c4d41af07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:03 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Flow 'volume_create_manager' (fb68d999-b5c3-48f5-ac5a-3989ac183084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:03 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-183317eb-a9d9-4c7e-b77d-9dedcd23466b tempest-CinderUnicodeTest-974929508 None] Created volume successfully. Jul 06 12:36:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "cinder-521ba021-6239-48a7-a3ef-f7ca691b6574-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-521ba021-6239-48a7-a3ef-f7ca691b6574-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "cinder-quobyte-521ba021-6239-48a7-a3ef-f7ca691b6574" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-quobyte-521ba021-6239-48a7-a3ef-f7ca691b6574" acquired by "delete_volume" :: waited 0.026s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:04 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab755ea4-bf8c-49dc-bd57-798b8ae694f6]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:04 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 Jul 06 12:36:04 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] Creating offline snapshot aa504154-58a9-45b8-9c22-bbe5f6648c7a of volume f8b49c47-0279-4032-9c44-278f07285563 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:36:05 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6ae367-5674-4849-a6b7-09560052f7ab]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:05 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563 Jul 06 12:36:05 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:05 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574" returned: 0 in 1.123s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:05 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574 Jul 06 12:36:05 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:06 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563" returned: 0 in 1.277s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:06 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a 1G Jul 06 12:36:06 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:06 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-521ba021-6239-48a7-a3ef-f7ca691b6574" returned: 0 in 1.115s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-quobyte-521ba021-6239-48a7-a3ef-f7ca691b6574" released by "delete_volume" :: held 2.366s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:06 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Created reservations ['b8f6a028-8baf-4183-8865-b78245c0387a', '66e23bc6-52c2-4781-824c-38f9a3537f7c', 'c2764471-2cfb-4b93-84f0-9f728b965643', '70e1b41a-d061-4997-bcaa-ea863bd40a72'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:06 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:36:06 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Flow 'volume_create_manager' (2bbc20c2-3153-4fa7-93f4-ab344c81c2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccc0413-c9d1-42b4-b65c-fa3b833369c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccc0413-c9d1-42b4-b65c-fa3b833369c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-320671003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be4f1de-aff4-485e-92de-3e79887b245c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e08d7e7b37a4e3192ce150e9ea3483d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:07Z,use_quota=True,user_id='a6e150beffaa49b1a1ed1e6ecb9ed965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d430e2f-6bf9-41b8-87c5-8921faa5cdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d430e2f-6bf9-41b8-87c5-8921faa5cdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dec0136-fc2f-43d0-a142-179c9503fa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dec0136-fc2f-43d0-a142-179c9503fa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5be4f1de-aff4-485e-92de-3e79887b245c', 'volume_name': 'volume-5be4f1de-aff4-485e-92de-3e79887b245c', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3effb3f6-5c8b-4450-a6b0-fd5d14afa597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:07 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3effb3f6-5c8b-4450-a6b0-fd5d14afa597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178e74b6-1037-4af3-b534-862c35b9df55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:07 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Volume 5be4f1de-aff4-485e-92de-3e79887b245c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5be4f1de-aff4-485e-92de-3e79887b245c', 'volume_size': 1} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.876s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:07 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Deleted volume successfully. Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-5d41eba0-9bc2-4ac6-a30a-0b6313a97a84 tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-521ba021-6239-48a7-a3ef-f7ca691b6574-delete_volume" released by "delete_volume" :: held 3.554s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:07 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "cinder-a32b3c74-98db-438f-8295-9567394ad249-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a 1G" returned: 0 in 1.466s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8b49c47-0279-4032-9c44-278f07285563 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:07 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8b49c47-0279-4032-9c44-278f07285563 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-a32b3c74-98db-438f-8295-9567394ad249-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:07 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "cinder-quobyte-a32b3c74-98db-438f-8295-9567394ad249" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-quobyte-a32b3c74-98db-438f-8295-9567394ad249" acquired by "delete_volume" :: waited 0.032s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:07 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e06cc05-ce52-4b0a-be89-4aec19578902]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a32b3c74-98db-438f-8295-9567394ad249 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:08 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a32b3c74-98db-438f-8295-9567394ad249 Jul 06 12:36:08 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:08 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8b49c47-0279-4032-9c44-278f07285563 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a" returned: 0 in 0.994s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:08 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a is being set with open permissions: ugo+rw Jul 06 12:36:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:08 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a Jul 06 12:36:08 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:08 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a32b3c74-98db-438f-8295-9567394ad249" returned: 0 in 0.870s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a32b3c74-98db-438f-8295-9567394ad249 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:08 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a32b3c74-98db-438f-8295-9567394ad249 Jul 06 12:36:08 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:09 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a" returned: 0 in 0.795s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:09 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.info Jul 06 12:36:09 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:09 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-a32b3c74-98db-438f-8295-9567394ad249" returned: 0 in 0.798s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-quobyte-a32b3c74-98db-438f-8295-9567394ad249" released by "delete_volume" :: held 1.729s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:09 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Created reservations ['d8e77699-bce7-4d1f-9fc5-3644b7ce372e', '646e0145-ae84-4a16-85e2-3e38e953eaca', '3c1b9c28-6f4a-4cdc-9621-f91c52b20063', 'ca7f9461-fcc4-4f98-b0b9-850d71913a49'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:09 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:36:09 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:10 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.info" returned: 0 in 0.713s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:10 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.info is being set with open permissions: ugo+rw Jul 06 12:36:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:10 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.info Jul 06 12:36:10 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:10 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.994s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:10 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:10 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Deleted volume successfully. Jul 06 12:36:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-54260e59-4aea-46d5-bfd7-62a637f985d3 tempest-VolumeDependencyTests-1333793962 None] Lock "cinder-a32b3c74-98db-438f-8295-9567394ad249-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:11 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.info" returned: 0 in 1.017s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.410s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.718s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:11 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-320671003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be4f1de-aff4-485e-92de-3e79887b245c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e08d7e7b37a4e3192ce150e9ea3483d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:07Z,use_quota=True,user_id='a6e150beffaa49b1a1ed1e6ecb9ed965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:11 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Creating volume 5be4f1de-aff4-485e-92de-3e79887b245c {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:11 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:11 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:11 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:11 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:36:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5be4f1de-aff4-485e-92de-3e79887b245c 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:11 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5be4f1de-aff4-485e-92de-3e79887b245c 1073741824 Jul 06 12:36:11 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:11 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-3ad5b04b-4dd9-47a1-bb26-616b24f1ea9f tempest-CinderUnicodeTest-974929508 None] Create snapshot completed successfully Jul 06 12:36:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Acquiring lock "cinder-aa504154-58a9-45b8-9c22-bbe5f6648c7a-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Lock "cinder-aa504154-58a9-45b8-9c22-bbe5f6648c7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Acquiring lock "cinder-quobyte-f8b49c47-0279-4032-9c44-278f07285563" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Lock "cinder-quobyte-f8b49c47-0279-4032-9c44-278f07285563" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Acquiring lock "cinder-quobyte-aa504154-58a9-45b8-9c22-bbe5f6648c7a" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Lock "cinder-quobyte-aa504154-58a9-45b8-9c22-bbe5f6648c7a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Deleting offline snapshot aa504154-58a9-45b8-9c22-bbe5f6648c7a of volume f8b49c47-0279-4032-9c44-278f07285563 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:36:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] snapshot_file for this snap is: volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:36:12 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfbfa82-009a-41bd-bfd9-2d7dfcfad0cf]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:12 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5be4f1de-aff4-485e-92de-3e79887b245c 1073741824" returned: 0 in 1.272s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:12 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a Jul 06 12:36:12 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5be4f1de-aff4-485e-92de-3e79887b245c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:12 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5be4f1de-aff4-485e-92de-3e79887b245c Jul 06 12:36:12 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:13 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a" returned: 0 in 1.080s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8b49c47-0279-4032-9c44-278f07285563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:36:13 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8306944-7d7a-43c8-9779-899ec84fbd7b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:13 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5be4f1de-aff4-485e-92de-3e79887b245c" returned: 0 in 1.117s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] <== create_volume: return (2446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:36:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.450s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:13 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563 Jul 06 12:36:13 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178e74b6-1037-4af3-b534-862c35b9df55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5be4f1de-aff4-485e-92de-3e79887b245c', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c364f39-aef5-40ec-baec-e33784b10948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:13 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Volume volume-5be4f1de-aff4-485e-92de-3e79887b245c (5be4f1de-aff4-485e-92de-3e79887b245c): created successfully Jul 06 12:36:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c364f39-aef5-40ec-baec-e33784b10948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Flow 'volume_create_manager' (2bbc20c2-3153-4fa7-93f4-ab344c81c2fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:13 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0e79cc7b-309e-49c1-8a14-dbb3afd22fa4 tempest-ProjectReaderTests-119694610 None] Created volume successfully. Jul 06 12:36:14 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563" returned: 0 in 0.994s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:14 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a Jul 06 12:36:14 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Acquiring lock "cinder-5be4f1de-aff4-485e-92de-3e79887b245c-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Lock "cinder-5be4f1de-aff4-485e-92de-3e79887b245c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Acquiring lock "cinder-quobyte-5be4f1de-aff4-485e-92de-3e79887b245c" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:15 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Lock "cinder-quobyte-5be4f1de-aff4-485e-92de-3e79887b245c" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:15 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb673b7-3431-4ba4-9bd2-45967ffdb3a4]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5be4f1de-aff4-485e-92de-3e79887b245c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:15 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5be4f1de-aff4-485e-92de-3e79887b245c Jul 06 12:36:15 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:15 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-c832d82d-e010-4b63-a38b-dd6b5be13a7d tempest-ProjectAdminTests-389440281 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7533416748047, 'free_capacity_gb': 1775.7533416748047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86761) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 12:36:15 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a" returned: 0 in 1.042s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:15 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a Jul 06 12:36:15 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:16 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5be4f1de-aff4-485e-92de-3e79887b245c" returned: 0 in 0.876s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5be4f1de-aff4-485e-92de-3e79887b245c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:16 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5be4f1de-aff4-485e-92de-3e79887b245c Jul 06 12:36:16 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:16 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563.aa504154-58a9-45b8-9c22-bbe5f6648c7a" returned: 0 in 0.732s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Lock "cinder-quobyte-aa504154-58a9-45b8-9c22-bbe5f6648c7a" released by "_delete_snapshot" :: held 4.000s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Lock "cinder-quobyte-f8b49c47-0279-4032-9c44-278f07285563" released by "delete_snapshot" :: held 4.034s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:16 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Created reservations ['a2badd3f-6dec-491c-bc9a-41088cb92c22', '31f889d3-2c0f-45d4-ae3e-3003c1b06f07', 'dfaea4a9-0f3d-4ed3-88f1-f2b531af39c3', '9b765cc6-c1aa-48a4-b619-d8c31c1429dc'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:16 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Delete snapshot completed successfully. Jul 06 12:36:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-d571a152-0a80-4fe4-a5c8-6ed34eb6fa9b tempest-CinderUnicodeTest-974929508 None] Lock "cinder-aa504154-58a9-45b8-9c22-bbe5f6648c7a-delete_snapshot" released by "delete_snapshot" :: held 4.228s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Acquiring lock "cinder-f8b49c47-0279-4032-9c44-278f07285563-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Lock "cinder-f8b49c47-0279-4032-9c44-278f07285563-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Acquiring lock "cinder-quobyte-f8b49c47-0279-4032-9c44-278f07285563" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:16 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Lock "cinder-quobyte-f8b49c47-0279-4032-9c44-278f07285563" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:16 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1568bd-9ebd-4508-b5c8-b29ace59b213]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:17 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563 Jul 06 12:36:17 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:17 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5be4f1de-aff4-485e-92de-3e79887b245c" returned: 0 in 0.808s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:17 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Lock "cinder-quobyte-5be4f1de-aff4-485e-92de-3e79887b245c" released by "delete_volume" :: held 1.731s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:17 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Created reservations ['e736411c-3922-4e51-9b35-d5ec0c7c5b82', '63307547-0663-41f3-be14-c1e50ea0f708', 'a1fce40b-513c-474d-8610-545492dbbbcd', 'fa3766ab-b745-4de8-b32b-462483462532'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:17 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:36:17 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:17 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563" returned: 0 in 0.997s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:17 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563 Jul 06 12:36:17 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:18 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.825s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:18 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Deleted volume successfully. Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f1fe4c42-211c-41e1-9ca3-fe14b73d944b tempest-ProjectReaderTests-119694610 None] Lock "cinder-5be4f1de-aff4-485e-92de-3e79887b245c-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Flow 'volume_create_manager' (b75c74a1-e9a3-4269-b955-fa6826dc3436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3211d3d-8676-46bd-b460-6dceeaf4f1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3211d3d-8676-46bd-b460-6dceeaf4f1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111748912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462249b2-1804-493a-891a-b0e159b6f81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e08d7e7b37a4e3192ce150e9ea3483d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:18Z,use_quota=True,user_id='a6e150beffaa49b1a1ed1e6ecb9ed965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876bb249-cb0b-4461-8cd2-2df6df93720e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876bb249-cb0b-4461-8cd2-2df6df93720e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3a581b-2df3-47f3-b9fb-e5ac477a6f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3a581b-2df3-47f3-b9fb-e5ac477a6f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '462249b2-1804-493a-891a-b0e159b6f81f', 'volume_name': 'volume-462249b2-1804-493a-891a-b0e159b6f81f', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cca3165-0c50-4c2c-b135-cfde29aba5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cca3165-0c50-4c2c-b135-cfde29aba5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51d4180-9b5e-4257-8c70-adccc9eb0773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:18 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Volume 462249b2-1804-493a-891a-b0e159b6f81f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-462249b2-1804-493a-891a-b0e159b6f81f', 'volume_size': 1} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111748912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462249b2-1804-493a-891a-b0e159b6f81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e08d7e7b37a4e3192ce150e9ea3483d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:18Z,use_quota=True,user_id='a6e150beffaa49b1a1ed1e6ecb9ed965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Creating volume 462249b2-1804-493a-891a-b0e159b6f81f {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:18 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-462249b2-1804-493a-891a-b0e159b6f81f 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:18 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-462249b2-1804-493a-891a-b0e159b6f81f 1073741824 Jul 06 12:36:18 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:18 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-f8b49c47-0279-4032-9c44-278f07285563" returned: 0 in 0.890s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Lock "cinder-quobyte-f8b49c47-0279-4032-9c44-278f07285563" released by "delete_volume" :: held 1.966s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Created reservations ['effc5cf7-ed0b-449b-b587-c141c1f1c71d', '27d3e4b6-ff36-4aad-b55c-e8c783053282', '092b0ae5-eeb9-407f-a91a-930bf588f332', '2cd0a3b8-9306-4eb3-a2cd-153d22e22a2d'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:19 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:19 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:36:19 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:19 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Acquiring lock "cinder-aa894c71-b4aa-43aa-9997-1df422bba004-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:19 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Lock "cinder-aa894c71-b4aa-43aa-9997-1df422bba004-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:19 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Acquiring lock "cinder-quobyte-aa894c71-b4aa-43aa-9997-1df422bba004" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:19 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Lock "cinder-quobyte-aa894c71-b4aa-43aa-9997-1df422bba004" acquired by "delete_volume" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:19 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1a570e-14e8-4151-81ba-fb9efb9d377c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa894c71-b4aa-43aa-9997-1df422bba004 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:19 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa894c71-b4aa-43aa-9997-1df422bba004 Jul 06 12:36:19 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:19 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-462249b2-1804-493a-891a-b0e159b6f81f 1073741824" returned: 0 in 0.968s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-462249b2-1804-493a-891a-b0e159b6f81f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:19 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-462249b2-1804-493a-891a-b0e159b6f81f Jul 06 12:36:19 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:19 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.878s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:19 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:19 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Deleted volume successfully. Jul 06 12:36:19 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bd947514-a6b2-4cd9-9f44-c777cefe7a2c tempest-CinderUnicodeTest-974929508 None] Lock "cinder-f8b49c47-0279-4032-9c44-278f07285563-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:20 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa894c71-b4aa-43aa-9997-1df422bba004" returned: 0 in 0.882s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa894c71-b4aa-43aa-9997-1df422bba004 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:20 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa894c71-b4aa-43aa-9997-1df422bba004 Jul 06 12:36:20 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:20 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-462249b2-1804-493a-891a-b0e159b6f81f" returned: 0 in 0.772s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:36:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51d4180-9b5e-4257-8c70-adccc9eb0773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-462249b2-1804-493a-891a-b0e159b6f81f', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f959bcc3-dcc0-41e9-8b05-72b8a713d765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:20 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Volume volume-462249b2-1804-493a-891a-b0e159b6f81f (462249b2-1804-493a-891a-b0e159b6f81f): created successfully Jul 06 12:36:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f959bcc3-dcc0-41e9-8b05-72b8a713d765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:20 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Flow 'volume_create_manager' (b75c74a1-e9a3-4269-b955-fa6826dc3436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:20 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a8aeab0c-0c99-449a-b009-51444dfe6bba tempest-ProjectReaderTests-119694610 None] Created volume successfully. Jul 06 12:36:20 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-aa894c71-b4aa-43aa-9997-1df422bba004" returned: 0 in 0.744s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Lock "cinder-quobyte-aa894c71-b4aa-43aa-9997-1df422bba004" released by "delete_volume" :: held 1.689s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Created reservations ['db5cc228-46b0-4b7c-bcc9-c5be6e8eac85', '5d986f24-7d19-4192-8071-0112b03e23de', '097c118f-e294-4e1e-ae3c-5e36d8e6d350', '5a8b6c88-99ea-4d04-8f7b-622865314a72'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:21 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:36:21 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (0c278ec8-7466-4b75-91a1-d7399152184f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba212dd1-65d1-4d3c-998d-483cfcad1dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba212dd1-65d1-4d3c-998d-483cfcad1dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1002261354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11aef9eb-7842-4a9a-af4d-32295c513fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:21Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ab5a70-88c7-42fb-9d8a-653fd1991fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ab5a70-88c7-42fb-9d8a-653fd1991fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df795b6e-d52e-4541-a0be-14cbd11a4c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df795b6e-d52e-4541-a0be-14cbd11a4c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11aef9eb-7842-4a9a-af4d-32295c513fb1', 'volume_name': 'volume-11aef9eb-7842-4a9a-af4d-32295c513fb1', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074f57fb-abe5-45c9-88b0-fe03b81e6828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074f57fb-abe5-45c9-88b0-fe03b81e6828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752e5dd4-204a-4fa3-91df-a7f812fbbc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:21 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Volume 11aef9eb-7842-4a9a-af4d-32295c513fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11aef9eb-7842-4a9a-af4d-32295c513fb1', 'volume_size': 1} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1002261354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11aef9eb-7842-4a9a-af4d-32295c513fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:21Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Creating volume 11aef9eb-7842-4a9a-af4d-32295c513fb1 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:21 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:21 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 1073741824 Jul 06 12:36:21 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Acquiring lock "cinder-462249b2-1804-493a-891a-b0e159b6f81f-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Lock "cinder-462249b2-1804-493a-891a-b0e159b6f81f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Acquiring lock "cinder-quobyte-462249b2-1804-493a-891a-b0e159b6f81f" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Lock "cinder-quobyte-462249b2-1804-493a-891a-b0e159b6f81f" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[716fa1ea-e520-4ba7-843d-34b485d7771b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-462249b2-1804-493a-891a-b0e159b6f81f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:21 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-462249b2-1804-493a-891a-b0e159b6f81f Jul 06 12:36:21 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:21 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.820s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:21 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Deleted volume successfully. Jul 06 12:36:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1f82cb8d-5ef5-401c-8c07-c910ae573851 tempest-CinderUnicodeTest-974929508 None] Lock "cinder-aa894c71-b4aa-43aa-9997-1df422bba004-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:22 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 1073741824" returned: 0 in 1.024s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:22 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 Jul 06 12:36:22 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:22 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-462249b2-1804-493a-891a-b0e159b6f81f" returned: 0 in 0.954s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-462249b2-1804-493a-891a-b0e159b6f81f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:22 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-462249b2-1804-493a-891a-b0e159b6f81f Jul 06 12:36:22 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:23 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1" returned: 0 in 0.826s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=160,cinder:SELECT=125,cinder:INSERT=42,cinder:DELETE=12 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752e5dd4-204a-4fa3-91df-a7f812fbbc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11aef9eb-7842-4a9a-af4d-32295c513fb1', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b11cd61-9d6d-4267-8d1e-7f5be197990f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:23 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Volume volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 (11aef9eb-7842-4a9a-af4d-32295c513fb1): created successfully Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b11cd61-9d6d-4267-8d1e-7f5be197990f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (0c278ec8-7466-4b75-91a1-d7399152184f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:23 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-386b2501-733e-42aa-b04d-402108816251 tempest-ProjectMemberTests-1918340834 None] Created volume successfully. Jul 06 12:36:23 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-462249b2-1804-493a-891a-b0e159b6f81f" returned: 0 in 0.849s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Lock "cinder-quobyte-462249b2-1804-493a-891a-b0e159b6f81f" released by "delete_volume" :: held 1.862s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=124,cinder:UPDATE=169,cinder:INSERT=48,cinder:DELETE=13 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Created reservations ['64309547-da3d-45ed-a00a-007ec983f4cb', '92a3fb6f-a654-4d36-b73a-9261f3f424e2', 'c2dfb807-7052-40e4-8d06-71d649f8ba41', '928ba032-ccfc-4e87-b248-fd2c8ce11c3e'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:23 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:36:23 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:24 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Flow 'volume_create_manager' (63154ea3-5583-4916-a6b2-581fa5602a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed87252-7822-45bc-ab79-1567e49db105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.834s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:24 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Deleted volume successfully. Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed87252-7822-45bc-ab79-1567e49db105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-298213451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d05a7d-8670-4abf-9f2e-36ddabebf39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e08d7e7b37a4e3192ce150e9ea3483d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:24Z,use_quota=True,user_id='a6e150beffaa49b1a1ed1e6ecb9ed965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd42d63-48ca-494e-8ca3-0afd21113625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd42d63-48ca-494e-8ca3-0afd21113625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a329e7-4714-49a7-b798-1d8c7ce20816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a329e7-4714-49a7-b798-1d8c7ce20816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d05a7d-8670-4abf-9f2e-36ddabebf39b', 'volume_name': 'volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fae5620-9617-473a-9cd7-4b59e33d49d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fae5620-9617-473a-9cd7-4b59e33d49d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c55874-6aba-43b8-9d2e-880f06cdd9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:24 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Volume 32d05a7d-8670-4abf-9f2e-36ddabebf39b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b', 'volume_size': 1} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-298213451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d05a7d-8670-4abf-9f2e-36ddabebf39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e08d7e7b37a4e3192ce150e9ea3483d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:24Z,use_quota=True,user_id='a6e150beffaa49b1a1ed1e6ecb9ed965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Creating volume 32d05a7d-8670-4abf-9f2e-36ddabebf39b {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:24 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:24 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b 1073741824 Jul 06 12:36:24 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-0772ea70-fd89-493d-8f1e-d17f84fdce1e tempest-ProjectReaderTests-119694610 None] Lock "cinder-462249b2-1804-493a-891a-b0e159b6f81f-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:25 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b 1073741824" returned: 0 in 0.929s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:25 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b Jul 06 12:36:25 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:26 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b" returned: 0 in 0.707s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.364s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c55874-6aba-43b8-9d2e-880f06cdd9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1efaf6a-8dd2-44f3-b42b-01ba08999592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] Creating offline snapshot 33c887f1-07cf-4b11-989e-ebd08992e09c of volume 11aef9eb-7842-4a9a-af4d-32295c513fb1 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:36:26 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Volume volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b (32d05a7d-8670-4abf-9f2e-36ddabebf39b): created successfully Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1efaf6a-8dd2-44f3-b42b-01ba08999592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Flow 'volume_create_manager' (63154ea3-5583-4916-a6b2-581fa5602a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d5cfcb-a475-448f-8bca-eccac3371d5c]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:26 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-733b2b4c-127c-4e06-aa50-4aca93d2a89d tempest-ProjectReaderTests-119694610 None] Created volume successfully. Jul 06 12:36:26 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 Jul 06 12:36:26 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Acquiring lock "cinder-32d05a7d-8670-4abf-9f2e-36ddabebf39b-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Lock "cinder-32d05a7d-8670-4abf-9f2e-36ddabebf39b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Acquiring lock "cinder-quobyte-32d05a7d-8670-4abf-9f2e-36ddabebf39b" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Lock "cinder-quobyte-32d05a7d-8670-4abf-9f2e-36ddabebf39b" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab0c9b9-6d82-4227-8c75-0abac5530ffa]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:26 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b Jul 06 12:36:26 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:27 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1" returned: 0 in 0.918s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:27 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c 1G Jul 06 12:36:27 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:27 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b" returned: 0 in 0.895s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:27 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b Jul 06 12:36:27 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:28 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c 1G" returned: 0 in 0.916s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:28 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c Jul 06 12:36:28 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:28 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-32d05a7d-8670-4abf-9f2e-36ddabebf39b" returned: 0 in 0.805s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:28 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Lock "cinder-quobyte-32d05a7d-8670-4abf-9f2e-36ddabebf39b" released by "delete_volume" :: held 1.772s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:28 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Created reservations ['55dcbe77-81d4-471c-b00c-2180632260dd', 'd88fea6d-1db8-4d65-8fb4-6c3a54b4e059', '2e35f0ae-d7db-4483-b566-5169333c93ee', '2843c1b5-1ffd-4024-8fa6-76cd2a0fef05'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:28 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:36:28 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:29 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c" returned: 0 in 0.842s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:29 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c is being set with open permissions: ugo+rw Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:29 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c Jul 06 12:36:29 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Flow 'volume_create_manager' (56a23187-ae5e-4a4f-88c7-14f5de575967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64dde54d-a984-45c9-89af-3e541cc4fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64dde54d-a984-45c9-89af-3e541cc4fd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1711255158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc805be-f900-416a-93bd-5c8fcc8e782f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e08d7e7b37a4e3192ce150e9ea3483d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:30Z,use_quota=True,user_id='a6e150beffaa49b1a1ed1e6ecb9ed965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393b8331-2720-4735-8494-fe383231f6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393b8331-2720-4735-8494-fe383231f6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0915a70a-b002-48f2-9b20-1b102ce02f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0915a70a-b002-48f2-9b20-1b102ce02f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc805be-f900-416a-93bd-5c8fcc8e782f', 'volume_name': 'volume-9fc805be-f900-416a-93bd-5c8fcc8e782f', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e8aff5-8927-4e18-89ff-2a36923abe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e8aff5-8927-4e18-89ff-2a36923abe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666a931e-d5b5-4e43-acbd-0e313d61bb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:29 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Volume 9fc805be-f900-416a-93bd-5c8fcc8e782f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc805be-f900-416a-93bd-5c8fcc8e782f', 'volume_size': 1} Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:29 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 1.053s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:29 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Deleted volume successfully. Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-380dd6cd-b3a5-49b7-99ff-4ff7870b935d tempest-ProjectReaderTests-119694610 None] Lock "cinder-32d05a7d-8670-4abf-9f2e-36ddabebf39b-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:29 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c" returned: 0 in 0.795s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:29 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.info Jul 06 12:36:29 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:30 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.info" returned: 0 in 0.744s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:30 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.info is being set with open permissions: ugo+rw Jul 06 12:36:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:30 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.info Jul 06 12:36:30 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:31 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.info" returned: 0 in 0.672s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.014s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.615s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1711255158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc805be-f900-416a-93bd-5c8fcc8e782f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e08d7e7b37a4e3192ce150e9ea3483d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:30Z,use_quota=True,user_id='a6e150beffaa49b1a1ed1e6ecb9ed965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Creating volume 9fc805be-f900-416a-93bd-5c8fcc8e782f {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:31 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9fc805be-f900-416a-93bd-5c8fcc8e782f 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:31 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9fc805be-f900-416a-93bd-5c8fcc8e782f 1073741824 Jul 06 12:36:31 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:31 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a1e202f4-a98f-4f74-8ff8-ac1a186cb3b4 tempest-ProjectMemberTests-1918340834 None] Create snapshot completed successfully Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Flow 'volume_create_manager' (3dd24054-b032-4fba-9817-f4d1dd9c7563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7afbfb-550f-47fa-bc63-2c70b20e85e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7afbfb-550f-47fa-bc63-2c70b20e85e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113716254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d623f11-7d47-4fb9-8291-d9851c53c3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44470c00830848ed9414401ddc340eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:31Z,use_quota=True,user_id='41b638a01380463bb7a7e2a560c31635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a55356-efd4-4732-85f7-c946050e9d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a55356-efd4-4732-85f7-c946050e9d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5958d2bf-bce9-4fcc-b2e7-fea8b0154649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5958d2bf-bce9-4fcc-b2e7-fea8b0154649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d623f11-7d47-4fb9-8291-d9851c53c3f7', 'volume_name': 'volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f503c5-e92b-485f-99b6-9b7973473fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f503c5-e92b-485f-99b6-9b7973473fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3c0ec3-a4b8-46d8-8176-d8f8b8bff7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:31 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Volume 5d623f11-7d47-4fb9-8291-d9851c53c3f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7', 'volume_size': 1} Jul 06 12:36:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:32 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9fc805be-f900-416a-93bd-5c8fcc8e782f 1073741824" returned: 0 in 0.923s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-33c887f1-07cf-4b11-989e-ebd08992e09c-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9fc805be-f900-416a-93bd-5c8fcc8e782f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Lock "cinder-33c887f1-07cf-4b11-989e-ebd08992e09c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-11aef9eb-7842-4a9a-af4d-32295c513fb1" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:32 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9fc805be-f900-416a-93bd-5c8fcc8e782f Jul 06 12:36:32 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-11aef9eb-7842-4a9a-af4d-32295c513fb1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-33c887f1-07cf-4b11-989e-ebd08992e09c" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-33c887f1-07cf-4b11-989e-ebd08992e09c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Deleting offline snapshot 33c887f1-07cf-4b11-989e-ebd08992e09c of volume 11aef9eb-7842-4a9a-af4d-32295c513fb1 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:36:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] snapshot_file for this snap is: volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:36:32 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6f42a0-f7db-4327-ac84-185a70b76ae6]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:32 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c Jul 06 12:36:32 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:33 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9fc805be-f900-416a-93bd-5c8fcc8e782f" returned: 0 in 0.740s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.429s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113716254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d623f11-7d47-4fb9-8291-d9851c53c3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44470c00830848ed9414401ddc340eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:31Z,use_quota=True,user_id='41b638a01380463bb7a7e2a560c31635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Creating volume 5d623f11-7d47-4fb9-8291-d9851c53c3f7 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:33 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666a931e-d5b5-4e43-acbd-0e313d61bb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc805be-f900-416a-93bd-5c8fcc8e782f', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:33 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 1073741824 Jul 06 12:36:33 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c12876-0506-416d-b37b-a846cc24bd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:33 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Volume volume-9fc805be-f900-416a-93bd-5c8fcc8e782f (9fc805be-f900-416a-93bd-5c8fcc8e782f): created successfully Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c12876-0506-416d-b37b-a846cc24bd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Flow 'volume_create_manager' (56a23187-ae5e-4a4f-88c7-14f5de575967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:33 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d60e274c-e821-4b50-a1c2-192fa0df7649 tempest-ProjectReaderTests-119694610 None] Created volume successfully. Jul 06 12:36:33 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c" returned: 0 in 0.918s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11aef9eb-7842-4a9a-af4d-32295c513fb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12319b3-fe74-4c3b-90cc-d17de4b72316]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:33 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 Jul 06 12:36:33 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Acquiring lock "cinder-9fc805be-f900-416a-93bd-5c8fcc8e782f-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Lock "cinder-9fc805be-f900-416a-93bd-5c8fcc8e782f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Acquiring lock "cinder-quobyte-9fc805be-f900-416a-93bd-5c8fcc8e782f" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Lock "cinder-quobyte-9fc805be-f900-416a-93bd-5c8fcc8e782f" acquired by "delete_volume" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a649ac8-de9d-42e4-a806-0db5d60b6a8b]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9fc805be-f900-416a-93bd-5c8fcc8e782f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:34 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 1073741824" returned: 0 in 1.016s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:34 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9fc805be-f900-416a-93bd-5c8fcc8e782f Jul 06 12:36:34 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:34 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 Jul 06 12:36:34 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:34 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1" returned: 0 in 0.853s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:34 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c Jul 06 12:36:34 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:34 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9fc805be-f900-416a-93bd-5c8fcc8e782f" returned: 0 in 0.870s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9fc805be-f900-416a-93bd-5c8fcc8e782f {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:34 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7" returned: 0 in 0.783s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:34 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:36:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:34 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9fc805be-f900-416a-93bd-5c8fcc8e782f Jul 06 12:36:34 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3c0ec3-a4b8-46d8-8176-d8f8b8bff7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:34 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:34 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb0e04d-2a11-4b16-bb99-25476a951124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:34 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Volume volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 (5d623f11-7d47-4fb9-8291-d9851c53c3f7): created successfully Jul 06 12:36:34 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb0e04d-2a11-4b16-bb99-25476a951124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:34 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Flow 'volume_create_manager' (3dd24054-b032-4fba-9817-f4d1dd9c7563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:34 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-8dcc6ad5-a670-4bfd-84d7-e2e0bfffa1c2 tempest-ProjectReaderTests-1070030554 None] Created volume successfully. Jul 06 12:36:35 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c" returned: 0 in 0.933s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:35 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c Jul 06 12:36:35 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:35 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9fc805be-f900-416a-93bd-5c8fcc8e782f" returned: 0 in 0.741s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Lock "cinder-quobyte-9fc805be-f900-416a-93bd-5c8fcc8e782f" released by "delete_volume" :: held 1.676s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:35 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Created reservations ['c4ec936d-bbd2-4b9e-bb2e-4fc4f6ae50e5', '22f88736-4ad2-43ce-ae64-2534cf5a6021', '9b811652-ab98-4c78-bb5c-e3ce776ad886', '1a3bb123-b28e-45f5-9ba2-75af4a465f4c'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:35 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:35 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:36:35 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:35 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1.33c887f1-07cf-4b11-989e-ebd08992e09c" returned: 0 in 0.768s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-33c887f1-07cf-4b11-989e-ebd08992e09c" released by "_delete_snapshot" :: held 3.630s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-11aef9eb-7842-4a9a-af4d-32295c513fb1" released by "delete_snapshot" :: held 3.663s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] Creating offline snapshot eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 of volume 5d623f11-7d47-4fb9-8291-d9851c53c3f7 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fba85ff-7db5-4b72-adf4-43bb7308d550]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Created reservations ['036da06a-a884-4aa6-a788-12e093d9abb6', 'bd1967a5-07eb-4b88-8cfd-eade7d3cb90d', 'fcc9d608-8196-404a-a861-5b20d8c46cf3', '9de74801-7090-4b46-bf4a-acc70553e7a7'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:36 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Delete snapshot completed successfully. Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-dccc5ee7-a444-4f33-9cef-6a18006f12dd tempest-ProjectMemberTests-1918340834 None] Lock "cinder-33c887f1-07cf-4b11-989e-ebd08992e09c-delete_snapshot" released by "delete_snapshot" :: held 3.962s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:36 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 Jul 06 12:36:36 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-11aef9eb-7842-4a9a-af4d-32295c513fb1-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Lock "cinder-11aef9eb-7842-4a9a-af4d-32295c513fb1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-11aef9eb-7842-4a9a-af4d-32295c513fb1" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-11aef9eb-7842-4a9a-af4d-32295c513fb1" acquired by "delete_volume" :: waited 0.029s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:36 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.951s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:36 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Deleted volume successfully. Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1b3e95-04f7-48de-8ae6-35b60e07c63e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-1630008f-8c41-4051-b199-7bd8cb93082a tempest-ProjectReaderTests-119694610 None] Lock "cinder-9fc805be-f900-416a-93bd-5c8fcc8e782f-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:36 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 Jul 06 12:36:36 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:37 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7" returned: 0 in 1.038s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:37 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 1G Jul 06 12:36:37 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:37 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1" returned: 0 in 0.925s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:37 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1 Jul 06 12:36:37 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:38 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 1G" returned: 0 in 1.142s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:38 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 Jul 06 12:36:38 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:38 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-11aef9eb-7842-4a9a-af4d-32295c513fb1" returned: 0 in 0.841s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-11aef9eb-7842-4a9a-af4d-32295c513fb1" released by "delete_volume" :: held 1.865s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:38 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Created reservations ['d7afa34b-d544-436f-9136-2c23c5df1479', '4851187b-7288-465f-bb61-8550aa249328', '4c1142ba-5408-4559-92b1-b33929beb970', 'fd30cbd7-b8ea-4bd6-81ec-1321dc6d754c'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:38 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:36:38 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:39 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0" returned: 0 in 0.831s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:39 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 is being set with open permissions: ugo+rw Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:39 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 Jul 06 12:36:39 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:39 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.741s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:39 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Deleted volume successfully. Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (52c6ab67-6a72-4ea6-a90f-c93e5afdf457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f989d3c-2ba8-4642-b574-03c1bede48c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-aa514618-fd07-45a7-80de-f98c6604b1da tempest-ProjectMemberTests-1918340834 None] Lock "cinder-11aef9eb-7842-4a9a-af4d-32295c513fb1-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f989d3c-2ba8-4642-b574-03c1bede48c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673741929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4097a5d7-1f06-4f00-8427-f5c1dd866643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:39Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fff04a-ea85-45fa-9cf9-76614966e66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fff04a-ea85-45fa-9cf9-76614966e66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52279c9-ba92-42fd-8a80-f9b66b990f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52279c9-ba92-42fd-8a80-f9b66b990f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4097a5d7-1f06-4f00-8427-f5c1dd866643', 'volume_name': 'volume-4097a5d7-1f06-4f00-8427-f5c1dd866643', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb39af32-682b-4bc1-b308-aacdf4c6b1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb39af32-682b-4bc1-b308-aacdf4c6b1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0372cf-cb0e-4c5e-9965-85684bab71a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:39 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Volume 4097a5d7-1f06-4f00-8427-f5c1dd866643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4097a5d7-1f06-4f00-8427-f5c1dd866643', 'volume_size': 1} Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:39 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0" returned: 0 in 0.741s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:39 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.info Jul 06 12:36:39 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:40 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.info" returned: 0 in 0.685s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:40 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.info is being set with open permissions: ugo+rw Jul 06 12:36:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:40 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.info Jul 06 12:36:40 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:41 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.info" returned: 0 in 0.661s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.213s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.688s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673741929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4097a5d7-1f06-4f00-8427-f5c1dd866643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:39Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Creating volume 4097a5d7-1f06-4f00-8427-f5c1dd866643 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:41 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:41 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:36:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:41 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 1073741824 Jul 06 12:36:41 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:41 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-789cf054-aa7e-489a-9fd8-fdc781c3c240 tempest-ProjectReaderTests-1070030554 None] Create snapshot completed successfully Jul 06 12:36:42 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 1073741824" returned: 0 in 0.845s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:42 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 Jul 06 12:36:42 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-quobyte-5d623f11-7d47-4fb9-8291-d9851c53c3f7" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-5d623f11-7d47-4fb9-8291-d9851c53c3f7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-quobyte-eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Deleting offline snapshot eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 of volume 5d623f11-7d47-4fb9-8291-d9851c53c3f7 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] snapshot_file for this snap is: volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9c51a5-be46-45d3-8017-df7fd08bd645]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:42 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643" returned: 0 in 0.723s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0372cf-cb0e-4c5e-9965-85684bab71a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4097a5d7-1f06-4f00-8427-f5c1dd866643', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b062e9-34b5-488c-a8bc-752bc99cb294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:42 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 Jul 06 12:36:42 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:42 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Volume volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 (4097a5d7-1f06-4f00-8427-f5c1dd866643): created successfully Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b062e9-34b5-488c-a8bc-752bc99cb294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:42 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (52c6ab67-6a72-4ea6-a90f-c93e5afdf457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:42 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-e5176e7f-84f8-4123-ae71-972bea762dc5 tempest-ProjectMemberTests-1918340834 None] Created volume successfully. Jul 06 12:36:43 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0" returned: 0 in 0.856s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:36:43 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fc6446-7aad-44b7-966b-70f50af7e349]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:43 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 Jul 06 12:36:43 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] Creating offline snapshot 3f8cbabe-9f79-4612-bace-78782e2dcda8 of volume 4097a5d7-1f06-4f00-8427-f5c1dd866643 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:36:43 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2a931c-03d6-4ffc-8994-8a92e7c0333a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:43 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 Jul 06 12:36:43 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:44 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7" returned: 0 in 0.858s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:44 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 Jul 06 12:36:44 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:44 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643" returned: 0 in 0.782s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:44 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8 1G Jul 06 12:36:44 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:45 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0" returned: 0 in 0.783s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:45 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0 Jul 06 12:36:45 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:45 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8 1G" returned: 0 in 0.886s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:45 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8 Jul 06 12:36:45 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:46 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7.eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0" returned: 0 in 0.726s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:46 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0" released by "_delete_snapshot" :: held 3.348s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:46 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-5d623f11-7d47-4fb9-8291-d9851c53c3f7" released by "delete_snapshot" :: held 3.372s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:46 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Created reservations ['4d01e0bf-9d49-43b0-8bf4-81c902f533ae', '9a0958ce-4efd-4da0-b0c1-06b4bf4a68ea', 'eb99fe91-6d47-4bc4-b041-e45a8a97cfd6', 'e00c8f1b-7008-462a-b87f-a6f4000a01ba'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:46 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Delete snapshot completed successfully. Jul 06 12:36:46 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-bb16f419-a72a-4a56-a977-226e95b3ca43 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-eaeb4de8-7f31-4b5e-8e69-c057b26bc5d0-delete_snapshot" released by "delete_snapshot" :: held 3.525s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:46 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8" returned: 0 in 0.779s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:46 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8 is being set with open permissions: ugo+rw Jul 06 12:36:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:46 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8 Jul 06 12:36:46 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:46 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-5d623f11-7d47-4fb9-8291-d9851c53c3f7-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:46 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Lock "cinder-5d623f11-7d47-4fb9-8291-d9851c53c3f7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-quobyte-5d623f11-7d47-4fb9-8291-d9851c53c3f7" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:47 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8" returned: 0 in 0.689s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:47 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-5d623f11-7d47-4fb9-8291-d9851c53c3f7" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:47 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdf855a-85bb-46a3-8446-58d4e972d5ba]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:47 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.info Jul 06 12:36:47 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:47 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 Jul 06 12:36:47 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:47 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.info" returned: 0 in 0.673s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:47 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.info is being set with open permissions: ugo+rw Jul 06 12:36:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:47 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.info Jul 06 12:36:47 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:47 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7" returned: 0 in 0.794s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:47 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7 Jul 06 12:36:47 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:48 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.info" returned: 0 in 0.697s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.654s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:48 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-3ee03ef4-6d0f-4c89-b4b2-810161b9b090 tempest-ProjectMemberTests-1918340834 None] Create snapshot completed successfully Jul 06 12:36:48 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-5d623f11-7d47-4fb9-8291-d9851c53c3f7" returned: 0 in 0.709s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-5d623f11-7d47-4fb9-8291-d9851c53c3f7" released by "delete_volume" :: held 1.591s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:48 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Created reservations ['363967a1-6464-4e66-a0bb-35c7ba8021e5', 'abbbf066-f7c7-4309-b787-bc5c70d17d13', 'a3dc77ab-1b07-462d-a212-ef04acf8eefe', 'c5b8a79f-8d85-4650-a514-33ab45f8c355'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:48 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:48 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:36:48 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-3f8cbabe-9f79-4612-bace-78782e2dcda8-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-3f8cbabe-9f79-4612-bace-78782e2dcda8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-4097a5d7-1f06-4f00-8427-f5c1dd866643" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-4097a5d7-1f06-4f00-8427-f5c1dd866643" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-3f8cbabe-9f79-4612-bace-78782e2dcda8" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-3f8cbabe-9f79-4612-bace-78782e2dcda8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Deleting offline snapshot 3f8cbabe-9f79-4612-bace-78782e2dcda8 of volume 4097a5d7-1f06-4f00-8427-f5c1dd866643 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] snapshot_file for this snap is: volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[920835ca-a83b-4f7d-ad3b-6760d3c81093]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:49 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8 Jul 06 12:36:49 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:49 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.753s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:49 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Deleted volume successfully. Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-829eb5e1-2056-405e-8502-d1c49809749b tempest-ProjectReaderTests-1070030554 None] Lock "cinder-5d623f11-7d47-4fb9-8291-d9851c53c3f7-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Flow 'volume_create_manager' (63b8d155-4a6a-45d6-961f-30de14c0be46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d318807-9a92-4e54-896c-7ff698e4acb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d318807-9a92-4e54-896c-7ff698e4acb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1026988308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b775b3-b5b0-46fe-a60e-cf8dc8e076e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44470c00830848ed9414401ddc340eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:50Z,use_quota=True,user_id='41b638a01380463bb7a7e2a560c31635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d64f986-31bf-426d-9994-6c7a69f7d86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d64f986-31bf-426d-9994-6c7a69f7d86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398bcb38-4b17-49fd-bdd2-43807c0289bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398bcb38-4b17-49fd-bdd2-43807c0289bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83b775b3-b5b0-46fe-a60e-cf8dc8e076e3', 'volume_name': 'volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac284eb-7d86-407f-8d69-ecd5a5d2459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac284eb-7d86-407f-8d69-ecd5a5d2459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5664469b-ec74-43a1-a779-2d1af7335f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:49 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Volume 83b775b3-b5b0-46fe-a60e-cf8dc8e076e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3', 'volume_size': 1} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1026988308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b775b3-b5b0-46fe-a60e-cf8dc8e076e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44470c00830848ed9414401ddc340eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:50Z,use_quota=True,user_id='41b638a01380463bb7a7e2a560c31635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Creating volume 83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:49 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:36:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:49 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 1073741824 Jul 06 12:36:49 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:50 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8" returned: 0 in 0.843s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4097a5d7-1f06-4f00-8427-f5c1dd866643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:36:50 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb63197-90b5-49cb-862c-2756568accd8]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:50 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 Jul 06 12:36:50 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:50 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 1073741824" returned: 0 in 0.882s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:50 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 Jul 06 12:36:50 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:50 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643" returned: 0 in 0.797s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:50 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8 Jul 06 12:36:50 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:51 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3" returned: 0 in 0.684s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:51 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:36:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5664469b-ec74-43a1-a779-2d1af7335f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1304d99-694c-4079-8411-425ca5863b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:51 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Volume volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 (83b775b3-b5b0-46fe-a60e-cf8dc8e076e3): created successfully Jul 06 12:36:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1304d99-694c-4079-8411-425ca5863b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Flow 'volume_create_manager' (63b8d155-4a6a-45d6-961f-30de14c0be46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-17cba3c7-5252-4ac3-8d91-5476cffd3160 tempest-ProjectReaderTests-1070030554 None] Created volume successfully. Jul 06 12:36:51 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8" returned: 0 in 0.776s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:51 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8 Jul 06 12:36:51 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] Creating offline snapshot 8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 of volume 83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6cb912-e2b7-4717-b37a-facab93b0010]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:52 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 Jul 06 12:36:52 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:52 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643.3f8cbabe-9f79-4612-bace-78782e2dcda8" returned: 0 in 0.714s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-3f8cbabe-9f79-4612-bace-78782e2dcda8" released by "_delete_snapshot" :: held 3.236s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-4097a5d7-1f06-4f00-8427-f5c1dd866643" released by "delete_snapshot" :: held 3.262s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Created reservations ['3868559a-ea97-4619-b9e5-5c87a081bf62', 'b049a3d6-2655-4964-98f6-89832f877899', '1df730e2-4eec-4c77-ac2a-9a4e1d389cdc', '2777cd0e-2b94-441b-9919-97ddc0a49625'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:52 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Delete snapshot completed successfully. Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c46d8193-9d2a-4c6e-a19d-152313c59ae8 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-3f8cbabe-9f79-4612-bace-78782e2dcda8-delete_snapshot" released by "delete_snapshot" :: held 3.419s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:52 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:36:52 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:52 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3" returned: 0 in 0.798s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:52 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 1G Jul 06 12:36:52 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:53 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.679s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:36:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:36:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:36:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-4097a5d7-1f06-4f00-8427-f5c1dd866643-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-4097a5d7-1f06-4f00-8427-f5c1dd866643-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-4097a5d7-1f06-4f00-8427-f5c1dd866643" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-4097a5d7-1f06-4f00-8427-f5c1dd866643" acquired by "delete_volume" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:53 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5eb5836-4dad-48bb-a9ef-398ca9b206a8]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:53 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 Jul 06 12:36:53 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:53 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 1G" returned: 0 in 0.882s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:53 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 Jul 06 12:36:53 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:54 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643" returned: 0 in 0.835s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:54 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643 Jul 06 12:36:54 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:54 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379" returned: 0 in 0.718s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:54 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 is being set with open permissions: ugo+rw Jul 06 12:36:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:54 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 Jul 06 12:36:54 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:55 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-4097a5d7-1f06-4f00-8427-f5c1dd866643" returned: 0 in 0.701s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:55 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:55 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-4097a5d7-1f06-4f00-8427-f5c1dd866643" released by "delete_volume" :: held 1.613s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379" returned: 0 in 0.656s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:55 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.info Jul 06 12:36:55 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:55 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Created reservations ['b390ff9d-3bd8-43e9-a681-399628fafe1d', 'bca0e196-5265-4495-8a7d-607424ca9a97', '31631b35-77f7-477f-b038-46d3e4bdea42', '4bc432e4-f26e-4c2e-8840-d4ef4113c77f'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:55 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:55 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:36:55 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:55 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.info" returned: 0 in 0.717s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:55 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.info is being set with open permissions: ugo+rw Jul 06 12:36:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:55 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.info Jul 06 12:36:55 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:56 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.796s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:56 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Deleted volume successfully. Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c73af0aa-275f-4d76-a46d-a7318128ec30 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-4097a5d7-1f06-4f00-8427-f5c1dd866643-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (cd2618c9-eea5-4434-8f5c-8851bfda6e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c68c6f-eaa0-48ca-9916-4ed6adb55899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c68c6f-eaa0-48ca-9916-4ed6adb55899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-758904218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9afea103-9e91-41a8-bcc4-76c0a98d46c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:56Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f28dfd8-b1b0-4056-83f3-436971a55a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f28dfd8-b1b0-4056-83f3-436971a55a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7271b4c2-2779-4b2e-8ae0-7d90549d2e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7271b4c2-2779-4b2e-8ae0-7d90549d2e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9afea103-9e91-41a8-bcc4-76c0a98d46c9', 'volume_name': 'volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf167a28-e0e4-4553-923c-e1d6e6c1d1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf167a28-e0e4-4553-923c-e1d6e6c1d1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc56a24-47d4-4596-98d3-957e1c461654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Volume 9afea103-9e91-41a8-bcc4-76c0a98d46c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9', 'volume_size': 1} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:56 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.info" returned: 0 in 0.764s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.618s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.298s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-758904218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9afea103-9e91-41a8-bcc4-76c0a98d46c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:56Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Creating volume 9afea103-9e91-41a8-bcc4-76c0a98d46c9 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:56 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:36:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:56 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 1073741824 Jul 06 12:36:56 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:56 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-330af158-8443-4944-8828-b8395475fd6e tempest-ProjectReaderTests-1070030554 None] Create snapshot completed successfully Jul 06 12:36:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-quobyte-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-quobyte-8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Deleting offline snapshot 8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 of volume 83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:36:57 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] snapshot_file for this snap is: volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:36:57 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ca401d-5723-4cf6-8dd1-b9369ec12a0f]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:57 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 Jul 06 12:36:57 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:57 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 1073741824" returned: 0 in 0.935s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:57 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 Jul 06 12:36:57 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:58 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379" returned: 0 in 0.843s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:36:58 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aa1909-3cea-4244-8c17-285dca736a8a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:58 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9" returned: 0 in 0.736s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:58 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:36:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc56a24-47d4-4596-98d3-957e1c461654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:58 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 Jul 06 12:36:58 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3481ad43-7cac-46cf-8c22-ff052016bc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:58 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Volume volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 (9afea103-9e91-41a8-bcc4-76c0a98d46c9): created successfully Jul 06 12:36:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3481ad43-7cac-46cf-8c22-ff052016bc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:58 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (cd2618c9-eea5-4434-8f5c-8851bfda6e54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:58 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d31f0e1e-e196-420f-9327-4ad7bcb70ecd tempest-ProjectMemberTests-1918340834 None] Created volume successfully. Jul 06 12:36:59 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3" returned: 0 in 0.778s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:59 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 Jul 06 12:36:59 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] Creating offline snapshot 678a04b8-5237-4fd5-8bf6-8c9364b536dd of volume 9afea103-9e91-41a8-bcc4-76c0a98d46c9 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:36:59 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d67fff-d5cd-45d1-896a-103ffe3fb6aa]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:59 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 Jul 06 12:36:59 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:59 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379" returned: 0 in 0.822s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:59 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379 Jul 06 12:36:59 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:00 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9" returned: 0 in 0.864s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:00 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd 1G Jul 06 12:37:00 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:00 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3.8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379" returned: 0 in 0.680s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379" released by "_delete_snapshot" :: held 3.250s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3" released by "delete_snapshot" :: held 3.273s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:00 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Created reservations ['9c15d91a-3913-42ab-975a-ba1a2fbde817', '290fde81-c64e-447b-b077-b2ef20a8adf7', '875bdb8c-3faa-43aa-9115-386383b698d9', '8adaea2d-70d8-49e6-ba41-109f78f4bd18'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:00 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Delete snapshot completed successfully. Jul 06 12:37:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-db54dcf0-8933-4b21-ae70-6b5d9c7d4870 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-8cbf3fa7-3b07-4a04-8bc4-f44cda9c6379-delete_snapshot" released by "delete_snapshot" :: held 3.422s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:01 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd 1G" returned: 0 in 0.877s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:01 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd Jul 06 12:37:01 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-quobyte-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:01 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3" acquired by "delete_volume" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:01 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[697a37a9-afcb-427f-98b3-c62d13244e54]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:01 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 Jul 06 12:37:01 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:02 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd" returned: 0 in 0.752s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:02 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd is being set with open permissions: ugo+rw Jul 06 12:37:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:02 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd Jul 06 12:37:02 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:02 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3" returned: 0 in 0.815s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:02 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3 Jul 06 12:37:02 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:02 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd" returned: 0 in 0.703s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:02 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.info Jul 06 12:37:02 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:03 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3" returned: 0 in 0.756s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3" released by "delete_volume" :: held 1.631s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:03 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Created reservations ['c97e8a34-f7d4-42b1-9626-daf4fcaee2b3', 'c8447ead-161c-4acf-8661-af49d930e7b0', 'd865658b-a35a-49c9-a207-285425543d2d', 'f3f2a146-4b24-4460-89a7-63c9db166859'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:03 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:03 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:37:03 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:03 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.info" returned: 0 in 0.696s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:03 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.info is being set with open permissions: ugo+rw Jul 06 12:37:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:03 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.info Jul 06 12:37:03 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:04 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.883s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:04 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Deleted volume successfully. Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Flow 'volume_create_manager' (1ca4083a-006f-452f-8a19-ecb4070c52d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c2128e-b334-4e7b-913a-cae58fee2664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:04 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.info" returned: 0 in 0.861s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.855s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c2128e-b334-4e7b-913a-cae58fee2664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1166430704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a867e6-e886-46e2-8a35-b7cc1605e245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44470c00830848ed9414401ddc340eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:04Z,use_quota=True,user_id='41b638a01380463bb7a7e2a560c31635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60dcf8a9-5a0b-4c2b-8449-7f3f2fe731c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60dcf8a9-5a0b-4c2b-8449-7f3f2fe731c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb31bfe-41c9-4f5d-8551-9f213ab326de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb31bfe-41c9-4f5d-8551-9f213ab326de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a867e6-e886-46e2-8a35-b7cc1605e245', 'volume_name': 'volume-20a867e6-e886-46e2-8a35-b7cc1605e245', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd696645-80c9-4644-b9c5-1b65bb710025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd696645-80c9-4644-b9c5-1b65bb710025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90f9263-606b-4bf6-bd92-fe178be13526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:04 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Volume 20a867e6-e886-46e2-8a35-b7cc1605e245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a867e6-e886-46e2-8a35-b7cc1605e245', 'volume_size': 1} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1166430704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a867e6-e886-46e2-8a35-b7cc1605e245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44470c00830848ed9414401ddc340eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:04Z,use_quota=True,user_id='41b638a01380463bb7a7e2a560c31635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Creating volume 20a867e6-e886-46e2-8a35-b7cc1605e245 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:04 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-61a720ee-afe3-401d-b9ca-1fb80cac57b2 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-83b775b3-b5b0-46fe-a60e-cf8dc8e076e3-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:04 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245 1073741824 Jul 06 12:37:04 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:04 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-08cea424-9136-4452-8bbb-cb06d1946d7b tempest-ProjectMemberTests-1918340834 None] Create snapshot completed successfully Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-678a04b8-5237-4fd5-8bf6-8c9364b536dd-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-678a04b8-5237-4fd5-8bf6-8c9364b536dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-9afea103-9e91-41a8-bcc4-76c0a98d46c9" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-9afea103-9e91-41a8-bcc4-76c0a98d46c9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-678a04b8-5237-4fd5-8bf6-8c9364b536dd" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-678a04b8-5237-4fd5-8bf6-8c9364b536dd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Deleting offline snapshot 678a04b8-5237-4fd5-8bf6-8c9364b536dd of volume 9afea103-9e91-41a8-bcc4-76c0a98d46c9 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] snapshot_file for this snap is: volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[470bcc06-dea3-4fd0-9ec8-5ccda8290689]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:05 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd Jul 06 12:37:05 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:05 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245 1073741824" returned: 0 in 1.004s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:05 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245 Jul 06 12:37:05 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:05 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd" returned: 0 in 0.865s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:37:05 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[6729e5dc-016e-4725-93f2-8b3adf3c54b0]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:05 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 Jul 06 12:37:05 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:06 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245" returned: 0 in 0.783s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:06 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90f9263-606b-4bf6-bd92-fe178be13526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a867e6-e886-46e2-8a35-b7cc1605e245', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe01d88-d75f-46b0-813d-21bf8f5a1b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:06 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Volume volume-20a867e6-e886-46e2-8a35-b7cc1605e245 (20a867e6-e886-46e2-8a35-b7cc1605e245): created successfully Jul 06 12:37:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe01d88-d75f-46b0-813d-21bf8f5a1b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Flow 'volume_create_manager' (1ca4083a-006f-452f-8a19-ecb4070c52d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:06 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d38c4f2e-7cf5-43a1-8e05-5f08d77d27df tempest-ProjectReaderTests-1070030554 None] Created volume successfully. Jul 06 12:37:06 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9" returned: 0 in 0.929s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:06 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd Jul 06 12:37:06 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:07 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd" returned: 0 in 0.844s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:07 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd Jul 06 12:37:07 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] Creating offline snapshot d46bf136-d5ef-455f-b6d3-9c6b66bc5dce of volume 20a867e6-e886-46e2-8a35-b7cc1605e245 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:37:07 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[36872078-aaf5-4147-868c-bb9fe1ca917a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:07 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245 Jul 06 12:37:07 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:08 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9.678a04b8-5237-4fd5-8bf6-8c9364b536dd" returned: 0 in 0.699s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-678a04b8-5237-4fd5-8bf6-8c9364b536dd" released by "_delete_snapshot" :: held 3.440s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-9afea103-9e91-41a8-bcc4-76c0a98d46c9" released by "delete_snapshot" :: held 3.464s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:08 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Created reservations ['b8a1492b-14ce-4c93-aa5d-c6f239844df6', '4d6b4ee5-cf6c-4600-a4e4-ca09427eb24b', 'ab3868d7-0270-4f4e-899d-4bae88cdc614', '1b03efd5-9b9a-466f-9e1e-b2048cf0b004'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:08 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Delete snapshot completed successfully. Jul 06 12:37:08 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-e88feeeb-a620-421a-b071-c9b93a8d6260 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-678a04b8-5237-4fd5-8bf6-8c9364b536dd-delete_snapshot" released by "delete_snapshot" :: held 3.634s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:08 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245" returned: 0 in 0.875s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.d46bf136-d5ef-455f-b6d3-9c6b66bc5dce 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:08 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.d46bf136-d5ef-455f-b6d3-9c6b66bc5dce 1G Jul 06 12:37:08 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-9afea103-9e91-41a8-bcc4-76c0a98d46c9-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-9afea103-9e91-41a8-bcc4-76c0a98d46c9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-9afea103-9e91-41a8-bcc4-76c0a98d46c9" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:09 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-9afea103-9e91-41a8-bcc4-76c0a98d46c9" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:09 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26f02c4-f762-4609-b1a4-b81c2b2f402a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:09 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 Jul 06 12:37:09 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:09 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.d46bf136-d5ef-455f-b6d3-9c6b66bc5dce 1G" returned: 0 in 0.860s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a867e6-e886-46e2-8a35-b7cc1605e245 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.d46bf136-d5ef-455f-b6d3-9c6b66bc5dce {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:09 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a867e6-e886-46e2-8a35-b7cc1605e245 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.d46bf136-d5ef-455f-b6d3-9c6b66bc5dce Jul 06 12:37:09 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:10 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9" returned: 0 in 0.808s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:10 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9 Jul 06 12:37:10 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:10 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a867e6-e886-46e2-8a35-b7cc1605e245 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.d46bf136-d5ef-455f-b6d3-9c6b66bc5dce" returned: 0 in 0.762s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:10 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.d46bf136-d5ef-455f-b6d3-9c6b66bc5dce is being set with open permissions: ugo+rw Jul 06 12:37:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.d46bf136-d5ef-455f-b6d3-9c6b66bc5dce {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:10 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.d46bf136-d5ef-455f-b6d3-9c6b66bc5dce Jul 06 12:37:10 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:10 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-9afea103-9e91-41a8-bcc4-76c0a98d46c9" returned: 0 in 0.647s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-9afea103-9e91-41a8-bcc4-76c0a98d46c9" released by "delete_volume" :: held 1.522s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:10 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Created reservations ['806d5fa0-78d2-4361-b08e-09d19e8c4cce', 'dfeade4b-7abe-4f8a-b515-b3cdb292ec53', '961b4ac7-77c9-412f-88b8-153691800f5a', 'cf6fcff7-8756-48bb-956a-e82864ccc4b9'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:10 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:10 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:37:10 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:10 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.d46bf136-d5ef-455f-b6d3-9c6b66bc5dce" returned: 0 in 0.686s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:11 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.info Jul 06 12:37:11 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:11 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.714s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:11 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Deleted volume successfully. Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-78ac0367-459d-45c0-b25a-efbed6457085 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-9afea103-9e91-41a8-bcc4-76c0a98d46c9-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:11 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.info" returned: 0 in 0.711s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:11 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.info is being set with open permissions: ugo+rw Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:11 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.info Jul 06 12:37:11 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (9050e99d-6bfc-42ad-b961-4255e314272c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb94d44-7433-4189-a28d-643901ca7c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb94d44-7433-4189-a28d-643901ca7c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-604212784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f512443-619e-41a7-86dd-75fb72991652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:12Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f328ac19-322b-4c7e-83bb-957d9d8aacf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f328ac19-322b-4c7e-83bb-957d9d8aacf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3283e9-53dc-44e5-b1ad-3ebb937179c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3283e9-53dc-44e5-b1ad-3ebb937179c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f512443-619e-41a7-86dd-75fb72991652', 'volume_name': 'volume-1f512443-619e-41a7-86dd-75fb72991652', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f437e485-8cb0-4d6a-965a-035fe2f996c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f437e485-8cb0-4d6a-965a-035fe2f996c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f10ee43-7639-4379-adc9-e54aa2d724a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:11 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Volume 1f512443-619e-41a7-86dd-75fb72991652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f512443-619e-41a7-86dd-75fb72991652', 'volume_size': 1} Jul 06 12:37:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:12 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-20a867e6-e886-46e2-8a35-b7cc1605e245.info" returned: 0 in 0.665s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.649s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.390s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-604212784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f512443-619e-41a7-86dd-75fb72991652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:12Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Creating volume 1f512443-619e-41a7-86dd-75fb72991652 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:12 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:12 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:37:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:12 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652 1073741824 Jul 06 12:37:12 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:12 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b56e987f-9a9a-4f8c-a5d1-950cfa594a6c tempest-ProjectReaderTests-1070030554 None] Create snapshot completed successfully Jul 06 12:37:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c516d261-6cfd-454f-aab4-ec3526663b22 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-d46bf136-d5ef-455f-b6d3-9c6b66bc5dce-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:12 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c516d261-6cfd-454f-aab4-ec3526663b22 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-d46bf136-d5ef-455f-b6d3-9c6b66bc5dce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:12 devstack cinder-volume[86761]: INFO cinder.message.api [None req-c516d261-6cfd-454f-aab4-ec3526663b22 tempest-ProjectReaderTests-1070030554 None] Creating message record for request_id = req-c516d261-6cfd-454f-aab4-ec3526663b22 Jul 06 12:37:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-c516d261-6cfd-454f-aab4-ec3526663b22 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-d46bf136-d5ef-455f-b6d3-9c6b66bc5dce-delete_snapshot" released by "delete_snapshot" :: held 0.043s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server [None req-c516d261-6cfd-454f-aab4-ec3526663b22 tempest-ProjectReaderTests-1070030554 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server raise self.value Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 12:37:13 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server Jul 06 12:37:13 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652 1073741824" returned: 0 in 0.874s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:13 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652 Jul 06 12:37:13 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:13 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652" returned: 0 in 0.661s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f10ee43-7639-4379-adc9-e54aa2d724a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f512443-619e-41a7-86dd-75fb72991652', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:13 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7651f0-943b-41d6-b4ac-91f28ada77a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:14 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Volume volume-1f512443-619e-41a7-86dd-75fb72991652 (1f512443-619e-41a7-86dd-75fb72991652): created successfully Jul 06 12:37:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7651f0-943b-41d6-b4ac-91f28ada77a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:14 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (9050e99d-6bfc-42ad-b961-4255e314272c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:14 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f871633e-c3d7-4411-8385-5b6af95fa574 tempest-ProjectMemberTests-1918340834 None] Created volume successfully. Jul 06 12:37:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] Creating offline snapshot 2f75ee8e-e57e-4446-bf15-ad07f06c37f3 of volume 1f512443-619e-41a7-86dd-75fb72991652 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:37:15 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[89039c3c-a0be-462a-834a-f8abceafc3ac]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:15 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652 Jul 06 12:37:15 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:16 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652" returned: 0 in 0.771s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:16 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3 1G Jul 06 12:37:16 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:16 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3 1G" returned: 0 in 0.879s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f512443-619e-41a7-86dd-75fb72991652 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:16 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f512443-619e-41a7-86dd-75fb72991652 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3 Jul 06 12:37:16 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:17 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f512443-619e-41a7-86dd-75fb72991652 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3" returned: 0 in 0.751s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:17 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3 is being set with open permissions: ugo+rw Jul 06 12:37:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:17 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3 Jul 06 12:37:17 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:18 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3" returned: 0 in 0.674s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:18 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.info Jul 06 12:37:18 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:18 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.info" returned: 0 in 0.630s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:19 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.info is being set with open permissions: ugo+rw Jul 06 12:37:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:19 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.info Jul 06 12:37:19 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:19 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.info" returned: 0 in 0.689s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.476s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:19 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-d7045b49-49f4-4271-8f04-27e8624f1b73 tempest-ProjectMemberTests-1918340834 None] Create snapshot completed successfully Jul 06 12:37:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-2f75ee8e-e57e-4446-bf15-ad07f06c37f3-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Lock "cinder-2f75ee8e-e57e-4446-bf15-ad07f06c37f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-1f512443-619e-41a7-86dd-75fb72991652" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-1f512443-619e-41a7-86dd-75fb72991652" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-2f75ee8e-e57e-4446-bf15-ad07f06c37f3" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:20 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-2f75ee8e-e57e-4446-bf15-ad07f06c37f3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Deleting offline snapshot 2f75ee8e-e57e-4446-bf15-ad07f06c37f3 of volume 1f512443-619e-41a7-86dd-75fb72991652 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:37:20 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] snapshot_file for this snap is: volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:37:20 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[0948339d-4b81-47fe-b99a-9be3c4d95a02]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:20 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3 Jul 06 12:37:20 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:21 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3" returned: 0 in 0.822s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f512443-619e-41a7-86dd-75fb72991652(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:37:21 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2b3334-370a-4a3c-830e-c78f3262478d]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:21 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652 Jul 06 12:37:21 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:22 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652" returned: 0 in 0.876s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:22 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3 Jul 06 12:37:22 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:23 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3" returned: 0 in 0.840s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:23 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3 Jul 06 12:37:23 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:23 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652.2f75ee8e-e57e-4446-bf15-ad07f06c37f3" returned: 0 in 0.857s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-2f75ee8e-e57e-4446-bf15-ad07f06c37f3" released by "_delete_snapshot" :: held 3.507s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-1f512443-619e-41a7-86dd-75fb72991652" released by "delete_snapshot" :: held 3.532s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:24 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:DELETE=9,cinder:SELECT=99,cinder:INSERT=32,cinder:UPDATE=128 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:37:24 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:INSERT=36,cinder:UPDATE=124,cinder:SELECT=98,cinder:DELETE=15 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:37:24 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Created reservations ['9b5f5f54-064c-42ee-bb5f-b617af086f7d', '2c66b158-5386-4cdf-a3e7-a8dcc34cf754', '210f56ef-cc9a-45b6-a6ca-6e1f7292d518', '0b1edd40-e921-4b12-a17d-caea1b2cdff4'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:24 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Delete snapshot completed successfully. Jul 06 12:37:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ae7a8e34-3101-412d-9df6-dda7306c475a tempest-ProjectMemberTests-1918340834 None] Lock "cinder-2f75ee8e-e57e-4446-bf15-ad07f06c37f3-delete_snapshot" released by "delete_snapshot" :: held 3.716s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-1f512443-619e-41a7-86dd-75fb72991652-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Lock "cinder-1f512443-619e-41a7-86dd-75fb72991652-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-1f512443-619e-41a7-86dd-75fb72991652" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-1f512443-619e-41a7-86dd-75fb72991652" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:24 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[93638093-997b-4f46-9f86-cef97c92c6d3]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:24 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652 Jul 06 12:37:24 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:25 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652" returned: 0 in 0.881s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:25 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652 Jul 06 12:37:25 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:26 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-1f512443-619e-41a7-86dd-75fb72991652" returned: 0 in 0.703s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:26 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-1f512443-619e-41a7-86dd-75fb72991652" released by "delete_volume" :: held 1.650s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:26 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Created reservations ['cb079644-df47-4001-b3d8-948757e982a5', '5863798d-8415-4622-a397-2ce673a9209d', '5148ac95-3bba-45a7-bad4-3f7154a915a8', 'b0e61560-0291-4af2-9030-a4ef0c29c5bd'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:26 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:37:26 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:27 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.792s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:27 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Deleted volume successfully. Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-205afd89-e1de-4116-a739-f77735ed366e tempest-ProjectMemberTests-1918340834 None] Lock "cinder-1f512443-619e-41a7-86dd-75fb72991652-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (393755c0-873b-4fb6-83ce-73583c2ec3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ab6e83-0787-474b-b08a-2c624d39700c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ab6e83-0787-474b-b08a-2c624d39700c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2137555037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e3aeae-2a19-4dcd-b594-3aa59d744bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:28Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b182de-97c0-4036-b432-1ccd9bb98a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b182de-97c0-4036-b432-1ccd9bb98a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f29fdc8-57cb-477d-aae2-d7fecd0fac6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f29fdc8-57cb-477d-aae2-d7fecd0fac6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e3aeae-2a19-4dcd-b594-3aa59d744bd1', 'volume_name': 'volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d55f9e8-8b0a-46e1-a43d-361ac9c40f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d55f9e8-8b0a-46e1-a43d-361ac9c40f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5c98cf-8f11-461e-a1b8-0c6daf0a138d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:27 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Volume 72e3aeae-2a19-4dcd-b594-3aa59d744bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1', 'volume_size': 1} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2137555037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e3aeae-2a19-4dcd-b594-3aa59d744bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:28Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Creating volume 72e3aeae-2a19-4dcd-b594-3aa59d744bd1 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:27 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:37:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:27 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1 1073741824 Jul 06 12:37:27 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:28 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1 1073741824" returned: 0 in 0.815s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:28 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1 Jul 06 12:37:28 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:29 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1" returned: 0 in 0.686s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5c98cf-8f11-461e-a1b8-0c6daf0a138d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0aa85cd-2f56-4088-a330-6a1231b6d3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:29 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Volume volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1 (72e3aeae-2a19-4dcd-b594-3aa59d744bd1): created successfully Jul 06 12:37:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0aa85cd-2f56-4088-a330-6a1231b6d3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:29 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (393755c0-873b-4fb6-83ce-73583c2ec3ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:29 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ffc1d1d0-e7ca-45fb-ad60-494b1e2a90cf tempest-ProjectMemberTests-1918340834 None] Created volume successfully. Jul 06 12:37:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:29 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] Creating offline snapshot 0427c608-d223-4630-bd25-5bfd0938c732 of volume 72e3aeae-2a19-4dcd-b594-3aa59d744bd1 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:37:29 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb257996-3da4-4bd5-b100-35f9b6de84a8]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:29 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1 Jul 06 12:37:29 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:30 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1" returned: 0 in 0.847s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.0427c608-d223-4630-bd25-5bfd0938c732 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:30 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.0427c608-d223-4630-bd25-5bfd0938c732 1G Jul 06 12:37:30 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:31 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.0427c608-d223-4630-bd25-5bfd0938c732 1G" returned: 0 in 0.851s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.0427c608-d223-4630-bd25-5bfd0938c732 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:31 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.0427c608-d223-4630-bd25-5bfd0938c732 Jul 06 12:37:31 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:32 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.0427c608-d223-4630-bd25-5bfd0938c732" returned: 0 in 0.712s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:32 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.0427c608-d223-4630-bd25-5bfd0938c732 is being set with open permissions: ugo+rw Jul 06 12:37:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.0427c608-d223-4630-bd25-5bfd0938c732 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:32 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.0427c608-d223-4630-bd25-5bfd0938c732 Jul 06 12:37:32 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:32 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.0427c608-d223-4630-bd25-5bfd0938c732" returned: 0 in 0.708s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:33 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.info Jul 06 12:37:33 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:33 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.info" returned: 0 in 0.668s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:33 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.info is being set with open permissions: ugo+rw Jul 06 12:37:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:33 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.info Jul 06 12:37:33 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:34 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-72e3aeae-2a19-4dcd-b594-3aa59d744bd1.info" returned: 0 in 0.650s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.532s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:34 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-5b2f6554-3970-4193-8a3d-9b2461efaa13 tempest-ProjectMemberTests-1918340834 None] Create snapshot completed successfully Jul 06 12:37:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fdb8a06d-8725-4107-8e5c-3e057495af84 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-0427c608-d223-4630-bd25-5bfd0938c732-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fdb8a06d-8725-4107-8e5c-3e057495af84 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-0427c608-d223-4630-bd25-5bfd0938c732-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:35 devstack cinder-volume[86761]: INFO cinder.message.api [None req-fdb8a06d-8725-4107-8e5c-3e057495af84 tempest-ProjectMemberTests-1918340834 None] Creating message record for request_id = req-fdb8a06d-8725-4107-8e5c-3e057495af84 Jul 06 12:37:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-fdb8a06d-8725-4107-8e5c-3e057495af84 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-0427c608-d223-4630-bd25-5bfd0938c732-delete_snapshot" released by "delete_snapshot" :: held 0.034s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server [None req-fdb8a06d-8725-4107-8e5c-3e057495af84 tempest-ProjectMemberTests-1918340834 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server raise self.value Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 12:37:35 devstack cinder-volume[86761]: ERROR oslo_messaging.rpc.server Jul 06 12:37:44 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:INSERT=5,cinder:UPDATE=19,cinder:SELECT=13,cinder:DELETE=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:37:45 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:37:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:37:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:52 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:37:52 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:53 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.715s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:37:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:37:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:38:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:38:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:52 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:38:52 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:53 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.795s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:38:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:38:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:39:36 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:39:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:39:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:52 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:39:52 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:53 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.712s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:39:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:39:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:39:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Flow 'volume_create_manager' (1e6f1aa5-3574-4ea5-815b-3b3a1ea21594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42237c52-a7cd-474f-87a7-f540760c6468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42237c52-a7cd-474f-87a7-f540760c6468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1016205816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce6d3167-be5f-427d-a4c8-d4173f3a48e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44470c00830848ed9414401ddc340eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:29Z,use_quota=True,user_id='41b638a01380463bb7a7e2a560c31635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af87adf-f62e-40a4-bd13-6db09179acd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af87adf-f62e-40a4-bd13-6db09179acd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c14d6d9-5fde-4667-8aeb-661c95201a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c14d6d9-5fde-4667-8aeb-661c95201a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce6d3167-be5f-427d-a4c8-d4173f3a48e9', 'volume_name': 'volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5ac04b-4868-4454-abef-df9d8fbfd01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5ac04b-4868-4454-abef-df9d8fbfd01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3143f0-42c0-4bba-80df-51962791e305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:28 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Volume ce6d3167-be5f-427d-a4c8-d4173f3a48e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9', 'volume_size': 1} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1016205816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce6d3167-be5f-427d-a4c8-d4173f3a48e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44470c00830848ed9414401ddc340eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:29Z,use_quota=True,user_id='41b638a01380463bb7a7e2a560c31635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Creating volume ce6d3167-be5f-427d-a4c8-d4173f3a48e9 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:40:28 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:40:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:28 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 1073741824 Jul 06 12:40:28 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:29 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 1073741824" returned: 0 in 0.891s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:29 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 Jul 06 12:40:29 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:30 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9" returned: 0 in 0.707s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:40:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3143f0-42c0-4bba-80df-51962791e305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952d5e5c-5348-4824-b9bb-4f918b8007c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:30 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Volume volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 (ce6d3167-be5f-427d-a4c8-d4173f3a48e9): created successfully Jul 06 12:40:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952d5e5c-5348-4824-b9bb-4f918b8007c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:30 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Flow 'volume_create_manager' (1e6f1aa5-3574-4ea5-815b-3b3a1ea21594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:30 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b072e10f-78de-4435-8d38-7a00ae679c17 tempest-ProjectReaderTests-1070030554 None] Created volume successfully. Jul 06 12:40:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:30 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] Creating offline snapshot 089188e7-d4bf-4717-9071-b3878fc62d55 of volume ce6d3167-be5f-427d-a4c8-d4173f3a48e9 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:40:30 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[15591941-f3e9-4f36-bf74-208d9043725e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:31 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 Jul 06 12:40:31 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:31 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9" returned: 0 in 0.757s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:31 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55 1G Jul 06 12:40:31 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:32 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55 1G" returned: 0 in 0.800s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:32 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55 Jul 06 12:40:32 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:33 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55" returned: 0 in 0.700s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:33 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55 is being set with open permissions: ugo+rw Jul 06 12:40:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:33 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55 Jul 06 12:40:33 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:33 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55" returned: 0 in 0.643s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:33 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.info Jul 06 12:40:33 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:34 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.info" returned: 0 in 0.673s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:34 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.info is being set with open permissions: ugo+rw Jul 06 12:40:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:34 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.info Jul 06 12:40:34 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:35 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.info" returned: 0 in 0.645s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.295s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:35 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-bf38c52d-8ac5-4f66-a244-bbb9146c8f22 tempest-ProjectReaderTests-1070030554 None] Create snapshot completed successfully Jul 06 12:40:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-089188e7-d4bf-4717-9071-b3878fc62d55-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Lock "cinder-089188e7-d4bf-4717-9071-b3878fc62d55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-quobyte-ce6d3167-be5f-427d-a4c8-d4173f3a48e9" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-ce6d3167-be5f-427d-a4c8-d4173f3a48e9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-quobyte-089188e7-d4bf-4717-9071-b3878fc62d55" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:36 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-089188e7-d4bf-4717-9071-b3878fc62d55" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Deleting offline snapshot 089188e7-d4bf-4717-9071-b3878fc62d55 of volume ce6d3167-be5f-427d-a4c8-d4173f3a48e9 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:40:36 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] snapshot_file for this snap is: volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:40:36 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[189a42f3-c30e-427b-8dbc-c7a15c395b98]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:36 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55 Jul 06 12:40:36 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:37 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55" returned: 0 in 0.776s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:40:37 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[101a440f-9ff1-430b-a254-0b9b5e2eb40a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:37 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 Jul 06 12:40:37 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:37 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9" returned: 0 in 0.762s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:37 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55 Jul 06 12:40:37 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:38 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55" returned: 0 in 0.735s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:38 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55 Jul 06 12:40:38 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:39 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9.089188e7-d4bf-4717-9071-b3878fc62d55" returned: 0 in 0.639s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-089188e7-d4bf-4717-9071-b3878fc62d55" released by "_delete_snapshot" :: held 3.009s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-ce6d3167-be5f-427d-a4c8-d4173f3a48e9" released by "delete_snapshot" :: held 3.033s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:39 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Created reservations ['2f080223-ff19-4a9b-b771-44496f233631', '784579d4-9090-4202-9120-0035acf3a285', '4fa86579-5887-4c9d-9284-130868318e8e', '02e1d8d1-392b-40e3-ae12-8882584fa4f1'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:39 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Delete snapshot completed successfully. Jul 06 12:40:39 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-09748201-31ef-4f44-8cce-528bdd12c6cc tempest-ProjectReaderTests-1070030554 None] Lock "cinder-089188e7-d4bf-4717-9071-b3878fc62d55-delete_snapshot" released by "delete_snapshot" :: held 3.182s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-ce6d3167-be5f-427d-a4c8-d4173f3a48e9-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-ce6d3167-be5f-427d-a4c8-d4173f3a48e9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-quobyte-ce6d3167-be5f-427d-a4c8-d4173f3a48e9" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:40 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-ce6d3167-be5f-427d-a4c8-d4173f3a48e9" acquired by "delete_volume" :: waited 0.028s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:40 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc59309-e828-469e-aa11-13c51ff13734]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:40 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 Jul 06 12:40:40 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:41 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9" returned: 0 in 0.802s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:41 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9 Jul 06 12:40:41 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:42 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-ce6d3167-be5f-427d-a4c8-d4173f3a48e9" returned: 0 in 0.651s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-ce6d3167-be5f-427d-a4c8-d4173f3a48e9" released by "delete_volume" :: held 1.510s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:42 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Created reservations ['33dae6c9-507d-4cac-8e06-92135d86a704', 'a4704020-867e-43a7-8346-3cef5679e038', '882312e5-9a2c-4a61-8a4f-1f84d4f3fa52', '3eff9b92-b007-4d14-8cf3-52c95b566a4e'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:42 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:42 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:40:42 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:42 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.705s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:42 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:40:42 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Deleted volume successfully. Jul 06 12:40:42 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-f6a872bb-659e-4969-9729-b5b8c7c999f3 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-ce6d3167-be5f-427d-a4c8-d4173f3a48e9-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Flow 'volume_create_manager' (1298a832-255c-4eda-b547-8b2d831ba624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef00396d-7135-4001-a197-907bbaafc798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef00396d-7135-4001-a197-907bbaafc798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-388542229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44470c00830848ed9414401ddc340eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:43Z,use_quota=True,user_id='41b638a01380463bb7a7e2a560c31635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30ecc42-729e-4406-ac15-91eabdba7459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30ecc42-729e-4406-ac15-91eabdba7459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c36a79-fdb3-46e9-bb35-eaed5c6e2ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c36a79-fdb3-46e9-bb35-eaed5c6e2ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50', 'volume_name': 'volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60771012-ba9a-482a-9940-577f3b104ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60771012-ba9a-482a-9940-577f3b104ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6bb446-0e28-4728-8609-5f217a811aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:43 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Volume 7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50', 'volume_size': 1} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-388542229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44470c00830848ed9414401ddc340eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:43Z,use_quota=True,user_id='41b638a01380463bb7a7e2a560c31635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Creating volume 7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:40:43 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:40:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:43 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 1073741824 Jul 06 12:40:43 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:44 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 1073741824" returned: 0 in 0.880s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:44 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 Jul 06 12:40:44 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:44 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50" returned: 0 in 0.674s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:44 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:40:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6bb446-0e28-4728-8609-5f217a811aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dafd123-2914-49ce-aa4b-41d15b37413d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:44 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Volume volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 (7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50): created successfully Jul 06 12:40:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dafd123-2914-49ce-aa4b-41d15b37413d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:44 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Flow 'volume_create_manager' (1298a832-255c-4eda-b547-8b2d831ba624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:44 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-949629c5-60f7-4da7-8235-e665a4c83044 tempest-ProjectReaderTests-1070030554 None] Created volume successfully. Jul 06 12:40:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] Creating offline snapshot 53d82d05-6db4-4de9-adf1-e3275380ae16 of volume 7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:40:45 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cea97d8-ffa2-4046-a95f-4dabb3a71184]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:45 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 Jul 06 12:40:45 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:46 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50" returned: 0 in 0.735s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:46 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16 1G Jul 06 12:40:46 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:47 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16 1G" returned: 0 in 0.831s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:47 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16 Jul 06 12:40:47 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:47 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16" returned: 0 in 0.705s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:47 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16 is being set with open permissions: ugo+rw Jul 06 12:40:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:47 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16 Jul 06 12:40:47 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:48 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16" returned: 0 in 0.672s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:48 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.info Jul 06 12:40:48 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:49 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.info" returned: 0 in 0.708s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:49 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.info is being set with open permissions: ugo+rw Jul 06 12:40:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:49 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.info Jul 06 12:40:49 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:49 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.info" returned: 0 in 0.665s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.397s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:49 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-e61817c9-64de-48d9-b6ac-3bcef608b90f tempest-ProjectReaderTests-1070030554 None] Create snapshot completed successfully Jul 06 12:40:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-53d82d05-6db4-4de9-adf1-e3275380ae16-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-53d82d05-6db4-4de9-adf1-e3275380ae16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-quobyte-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-quobyte-53d82d05-6db4-4de9-adf1-e3275380ae16" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-53d82d05-6db4-4de9-adf1-e3275380ae16" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Deleting offline snapshot 53d82d05-6db4-4de9-adf1-e3275380ae16 of volume 7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:40:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] snapshot_file for this snap is: volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:40:50 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16a7a8f-004b-4079-8f51-ca0b84621335]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:50 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16 Jul 06 12:40:50 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:51 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16" returned: 0 in 0.800s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:51 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:40:51 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26d0b1f-e220-472d-8744-6070c6ec6347]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:51 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 Jul 06 12:40:51 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:52 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50" returned: 0 in 0.813s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:52 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16 Jul 06 12:40:52 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (0ea8d26f-e157-4cff-be3f-48e16ad36db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80aa131-0a75-4494-8a9e-2ccb532bc51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:52 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:40:52 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80aa131-0a75-4494-8a9e-2ccb532bc51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1802167878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b06d12-e07d-4dcf-ba48-d1e54105bd11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:52Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe00c64-defa-4467-9b5f-ff16e2680d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe00c64-defa-4467-9b5f-ff16e2680d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c2eb34-905b-4d8f-8aaa-955e098b07cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c2eb34-905b-4d8f-8aaa-955e098b07cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b06d12-e07d-4dcf-ba48-d1e54105bd11', 'volume_name': 'volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b0cfb4-b076-4a68-b318-e6c871103091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b0cfb4-b076-4a68-b318-e6c871103091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91050715-889a-47fb-b3a0-9738ac2d20d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:52 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Volume 01b06d12-e07d-4dcf-ba48-d1e54105bd11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11', 'volume_size': 1} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1802167878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b06d12-e07d-4dcf-ba48-d1e54105bd11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:52Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Creating volume 01b06d12-e07d-4dcf-ba48-d1e54105bd11 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:40:52 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:40:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:52 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 1073741824 Jul 06 12:40:52 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:53 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16" returned: 0 in 0.781s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:53 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16 Jul 06 12:40:53 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:53 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.756s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:40:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:40:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:40:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:40:53 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 1073741824" returned: 0 in 0.915s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:53 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 Jul 06 12:40:53 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:53 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50.53d82d05-6db4-4de9-adf1-e3275380ae16" returned: 0 in 0.767s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-53d82d05-6db4-4de9-adf1-e3275380ae16" released by "_delete_snapshot" :: held 3.256s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:53 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50" released by "delete_snapshot" :: held 3.279s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Created reservations ['6f208e10-12b2-4c5a-aee4-a8c603665b9f', 'e3e08917-72ed-4667-8ba5-dd31488ee4c3', '52aaa60e-a426-4821-b1fe-c937e3cd1212', '8f99fe8e-d760-49bc-9612-720f4168ac2f'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:54 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Delete snapshot completed successfully. Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-33394265-016a-4969-9d58-59d193fdd8a3 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-53d82d05-6db4-4de9-adf1-e3275380ae16-delete_snapshot" released by "delete_snapshot" :: held 3.423s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:54 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11" returned: 0 in 0.665s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91050715-889a-47fb-b3a0-9738ac2d20d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3e0336-c014-41da-aedc-2ce823c50716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:54 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Volume volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 (01b06d12-e07d-4dcf-ba48-d1e54105bd11): created successfully Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3e0336-c014-41da-aedc-2ce823c50716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (0ea8d26f-e157-4cff-be3f-48e16ad36db4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:54 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-aab06c7a-737b-47de-a2cb-c95b1217bd12 tempest-ProjectMemberTests-1918340834 None] Created volume successfully. Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] Creating offline snapshot 3036f0f7-1d14-41ab-a551-393cac6f82dd of volume 01b06d12-e07d-4dcf-ba48-d1e54105bd11 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bb8f17-4e32-44a7-a808-4f1496558044]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Lock "cinder-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:54 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 Jul 06 12:40:54 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-quobyte-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:54 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50" acquired by "delete_volume" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:55 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0a1665-8e1f-4ebc-b2c4-9151cee8f908]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:55 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 Jul 06 12:40:55 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:55 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11" returned: 0 in 0.789s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:55 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd 1G Jul 06 12:40:55 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:55 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50" returned: 0 in 0.801s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:55 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50 Jul 06 12:40:55 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:56 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd 1G" returned: 0 in 0.899s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:56 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd Jul 06 12:40:56 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:56 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50" returned: 0 in 0.731s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:56 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50" released by "delete_volume" :: held 1.600s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:56 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Created reservations ['2f92e75f-9b2b-41bf-a4bf-22e8e9231674', 'bfc00f51-23b0-4e69-9f2b-e302d4cb8ac4', 'c67293bb-7de4-4590-9419-3fe6d7645672', '1ae6fa43-fcb5-4870-96e2-4becd039155b'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:56 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:56 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:40:56 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:57 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd" returned: 0 in 0.721s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:57 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd is being set with open permissions: ugo+rw Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:57 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd Jul 06 12:40:57 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:57 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.636s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:40:57 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Deleted volume successfully. Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-ab0e992b-97dc-4f89-ab17-06b01c87360c tempest-ProjectReaderTests-1070030554 None] Lock "cinder-7b9b2854-aeb4-48f2-a0e6-ce0e27bfed50-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Flow 'volume_create_manager' (4c3d3a5f-21a4-430a-945c-c508d6678600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55813082-2959-4666-bbd4-d552016a5912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55813082-2959-4666-bbd4-d552016a5912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-546120360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fde9b63-c078-408a-b8b7-046270793c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44470c00830848ed9414401ddc340eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:58Z,use_quota=True,user_id='41b638a01380463bb7a7e2a560c31635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8671c3dc-4568-4da4-9d68-c7de0286ea8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8671c3dc-4568-4da4-9d68-c7de0286ea8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7073f6f-974c-4fbb-a465-f835290bd7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7073f6f-974c-4fbb-a465-f835290bd7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fde9b63-c078-408a-b8b7-046270793c79', 'volume_name': 'volume-7fde9b63-c078-408a-b8b7-046270793c79', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0203c1-6d32-4f0f-9b48-b557a05bd034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0203c1-6d32-4f0f-9b48-b557a05bd034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a8d071-2f6c-4186-8650-c23e87a94873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:57 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Volume 7fde9b63-c078-408a-b8b7-046270793c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fde9b63-c078-408a-b8b7-046270793c79', 'volume_size': 1} Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:57 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd" returned: 0 in 0.656s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:57 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.info Jul 06 12:40:57 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:58 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.info" returned: 0 in 0.634s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:58 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.info is being set with open permissions: ugo+rw Jul 06 12:40:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:58 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.info Jul 06 12:40:58 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:59 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.info" returned: 0 in 0.641s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.429s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.534s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-546120360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fde9b63-c078-408a-b8b7-046270793c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44470c00830848ed9414401ddc340eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:58Z,use_quota=True,user_id='41b638a01380463bb7a7e2a560c31635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:40:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Creating volume 7fde9b63-c078-408a-b8b7-046270793c79 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:40:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:40:59 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:40:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:59 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79 1073741824 Jul 06 12:40:59 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:59 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-e83c903f-48f7-4f0d-b551-f9fa4367be63 tempest-ProjectMemberTests-1918340834 None] Create snapshot completed successfully Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-3036f0f7-1d14-41ab-a551-393cac6f82dd-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:00 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79 1073741824" returned: 0 in 0.817s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-3036f0f7-1d14-41ab-a551-393cac6f82dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-01b06d12-e07d-4dcf-ba48-d1e54105bd11" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-01b06d12-e07d-4dcf-ba48-d1e54105bd11" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-3036f0f7-1d14-41ab-a551-393cac6f82dd" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-3036f0f7-1d14-41ab-a551-393cac6f82dd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Deleting offline snapshot 3036f0f7-1d14-41ab-a551-393cac6f82dd of volume 01b06d12-e07d-4dcf-ba48-d1e54105bd11 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:41:00 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79 Jul 06 12:41:00 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] snapshot_file for this snap is: volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[c762880f-8206-4bdc-99da-dc3a30027488]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:00 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd Jul 06 12:41:00 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:00 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79" returned: 0 in 0.640s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a8d071-2f6c-4186-8650-c23e87a94873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fde9b63-c078-408a-b8b7-046270793c79', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95db6494-a874-49e0-b91d-9def2ff21507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:00 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Volume volume-7fde9b63-c078-408a-b8b7-046270793c79 (7fde9b63-c078-408a-b8b7-046270793c79): created successfully Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95db6494-a874-49e0-b91d-9def2ff21507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Flow 'volume_create_manager' (4c3d3a5f-21a4-430a-945c-c508d6678600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:41:00 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6d2e7306-b764-4ea3-b480-4aabdce082a1 tempest-ProjectReaderTests-1070030554 None] Created volume successfully. Jul 06 12:41:00 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd" returned: 0 in 0.778s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce479b3-ad0e-4346-b4d6-e79d7ccb590a]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:01 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 Jul 06 12:41:01 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:01 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11" returned: 0 in 0.744s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:01 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd Jul 06 12:41:01 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:01 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] Creating offline snapshot a0a0c254-0a21-41bf-99a0-8cf1a8fc744a of volume 7fde9b63-c078-408a-b8b7-046270793c79 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:41:01 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[2600331a-7330-49b2-9c34-406d5c5785a5]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:02 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79 Jul 06 12:41:02 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:02 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd" returned: 0 in 0.775s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:02 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd Jul 06 12:41:02 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:02 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79" returned: 0 in 0.809s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:02 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a 1G Jul 06 12:41:02 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:03 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11.3036f0f7-1d14-41ab-a551-393cac6f82dd" returned: 0 in 0.692s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-3036f0f7-1d14-41ab-a551-393cac6f82dd" released by "_delete_snapshot" :: held 3.086s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-01b06d12-e07d-4dcf-ba48-d1e54105bd11" released by "delete_snapshot" :: held 3.114s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:03 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Created reservations ['aebf51af-4440-430a-b463-88e45bbd44a7', '3aeb1360-da30-44ee-8678-a965aa30cf71', 'd34d6a08-5e03-4b38-ad06-961df53fb5bc', 'c05fc457-820c-42ff-9a49-834d5ab435af'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:41:03 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Delete snapshot completed successfully. Jul 06 12:41:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b105f7c0-f1df-459c-9912-50a6e616ca40 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-3036f0f7-1d14-41ab-a551-393cac6f82dd-delete_snapshot" released by "delete_snapshot" :: held 3.261s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:03 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a 1G" returned: 0 in 0.806s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fde9b63-c078-408a-b8b7-046270793c79 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:03 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fde9b63-c078-408a-b8b7-046270793c79 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a Jul 06 12:41:03 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-01b06d12-e07d-4dcf-ba48-d1e54105bd11-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-01b06d12-e07d-4dcf-ba48-d1e54105bd11-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-01b06d12-e07d-4dcf-ba48-d1e54105bd11" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:04 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fde9b63-c078-408a-b8b7-046270793c79 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a" returned: 0 in 0.747s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:04 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a is being set with open permissions: ugo+rw Jul 06 12:41:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:04 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-01b06d12-e07d-4dcf-ba48-d1e54105bd11" acquired by "delete_volume" :: waited 0.032s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:04 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a Jul 06 12:41:04 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:04 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[54202e84-9a7f-48cc-b567-4247976631ef]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:04 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 Jul 06 12:41:04 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:05 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a" returned: 0 in 0.693s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:05 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.info Jul 06 12:41:05 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:05 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11" returned: 0 in 0.775s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:05 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11 Jul 06 12:41:05 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:05 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.info" returned: 0 in 0.656s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:05 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.info is being set with open permissions: ugo+rw Jul 06 12:41:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:05 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.info Jul 06 12:41:05 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:05 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-01b06d12-e07d-4dcf-ba48-d1e54105bd11" returned: 0 in 0.632s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-01b06d12-e07d-4dcf-ba48-d1e54105bd11" released by "delete_volume" :: held 1.484s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:05 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Created reservations ['39a3b666-e099-49c9-9e19-bed2fbf116eb', 'c1246874-ad79-4680-a27d-948d2067ef70', '7e5ad285-e919-4b20-956d-1b0435363ea1', '00919eec-f41e-465d-be1f-5a8e084edb2f'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:41:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:41:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:41:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:05 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:41:05 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:06 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.info" returned: 0 in 0.660s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.468s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:06 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-57063c5d-46eb-4438-8f28-11174ce31834 tempest-ProjectReaderTests-1070030554 None] Create snapshot completed successfully Jul 06 12:41:06 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:06 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.670s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:06 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:41:06 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Deleted volume successfully. Jul 06 12:41:06 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-13d4965d-c5af-4650-9a56-07b94e885c44 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-01b06d12-e07d-4dcf-ba48-d1e54105bd11-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:06 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:41:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (6ade3ac0-1b3f-48a5-95c6-60f4b83350fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:41:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0861407-3826-443a-8dc3-629bcbbedf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0861407-3826-443a-8dc3-629bcbbedf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-643227160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08fe2da-18fe-4533-b4d8-88358c8b9f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:41:07Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89915241-39e9-490a-8820-0f2e486401c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:06 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89915241-39e9-490a-8820-0f2e486401c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d7e997-1192-4cb4-ab96-a5ccb9d815a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d7e997-1192-4cb4-ab96-a5ccb9d815a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c08fe2da-18fe-4533-b4d8-88358c8b9f2c', 'volume_name': 'volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03269353-6301-4bb6-aa2f-cad3b66ff0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03269353-6301-4bb6-aa2f-cad3b66ff0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a94edd-188c-4c25-a7b4-b5e033948825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:07 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Volume c08fe2da-18fe-4533-b4d8-88358c8b9f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c', 'volume_size': 1} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-643227160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08fe2da-18fe-4533-b4d8-88358c8b9f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:41:07Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Creating volume c08fe2da-18fe-4533-b4d8-88358c8b9f2c {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:41:07 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:07 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c 1073741824 Jul 06 12:41:07 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-a0a0c254-0a21-41bf-99a0-8cf1a8fc744a-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-a0a0c254-0a21-41bf-99a0-8cf1a8fc744a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-quobyte-7fde9b63-c078-408a-b8b7-046270793c79" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-7fde9b63-c078-408a-b8b7-046270793c79" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-quobyte-a0a0c254-0a21-41bf-99a0-8cf1a8fc744a" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-a0a0c254-0a21-41bf-99a0-8cf1a8fc744a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Deleting offline snapshot a0a0c254-0a21-41bf-99a0-8cf1a8fc744a of volume 7fde9b63-c078-408a-b8b7-046270793c79 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] snapshot_file for this snap is: volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddbe300-6adb-43a2-89be-69d6f84db833]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:07 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a Jul 06 12:41:07 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:07 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c 1073741824" returned: 0 in 0.821s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:07 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:07 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c Jul 06 12:41:07 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:08 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a" returned: 0 in 0.768s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fde9b63-c078-408a-b8b7-046270793c79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:41:08 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ab2f8b-1988-4138-85af-24103cfd07bb]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:08 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79 Jul 06 12:41:08 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:08 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c" returned: 0 in 0.637s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:08 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:41:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a94edd-188c-4c25-a7b4-b5e033948825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6077cc-fb7e-4009-a8ee-b22ceb0998ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:08 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Volume volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c (c08fe2da-18fe-4533-b4d8-88358c8b9f2c): created successfully Jul 06 12:41:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6077cc-fb7e-4009-a8ee-b22ceb0998ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:08 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (6ade3ac0-1b3f-48a5-95c6-60f4b83350fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:41:08 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-153c5f79-1d71-410b-a4e1-c02b478dd7b4 tempest-ProjectMemberTests-1918340834 None] Created volume successfully. Jul 06 12:41:08 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79" returned: 0 in 0.736s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:08 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:08 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a Jul 06 12:41:08 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:09 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] Creating offline snapshot 918387dd-1639-49ac-88cd-44bb2bd3fdd7 of volume c08fe2da-18fe-4533-b4d8-88358c8b9f2c {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:41:09 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d993d1-c263-4bd5-bceb-52250ab0d863]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:09 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c Jul 06 12:41:09 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:09 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a" returned: 0 in 0.731s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:09 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:09 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a Jul 06 12:41:09 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:10 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c" returned: 0 in 0.786s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:10 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7 1G Jul 06 12:41:10 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:10 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79.a0a0c254-0a21-41bf-99a0-8cf1a8fc744a" returned: 0 in 0.670s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-a0a0c254-0a21-41bf-99a0-8cf1a8fc744a" released by "_delete_snapshot" :: held 3.008s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-7fde9b63-c078-408a-b8b7-046270793c79" released by "delete_snapshot" :: held 3.034s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:10 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Created reservations ['518d0292-bcf2-4f93-b2b0-9a27530d8bba', '00ad902d-7e90-47d7-8a67-d85b633f2fff', 'acba1078-b1f4-46b0-b033-f76ce8301b60', '2b61eccf-292e-419b-a213-c258ca05ab5e'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:41:10 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Delete snapshot completed successfully. Jul 06 12:41:10 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-493bdb85-3bd2-48ef-9549-45440f4352e4 tempest-ProjectReaderTests-1070030554 None] Lock "cinder-a0a0c254-0a21-41bf-99a0-8cf1a8fc744a-delete_snapshot" released by "delete_snapshot" :: held 3.176s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:10 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7 1G" returned: 0 in 0.767s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:10 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:10 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7 Jul 06 12:41:10 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-7fde9b63-c078-408a-b8b7-046270793c79-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Lock "cinder-7fde9b63-c078-408a-b8b7-046270793c79-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Acquiring lock "cinder-quobyte-7fde9b63-c078-408a-b8b7-046270793c79" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:11 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-7fde9b63-c078-408a-b8b7-046270793c79" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:11 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d58c9f-7379-4e6c-a8e5-d718330e4a52]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:11 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:11 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79 Jul 06 12:41:11 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7" returned: 0 in 0.808s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:11 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7 is being set with open permissions: ugo+rw Jul 06 12:41:11 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:11 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7 Jul 06 12:41:11 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:12 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7" returned: 0 in 0.665s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:12 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79" returned: 0 in 0.817s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:12 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.info Jul 06 12:41:12 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:12 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79 Jul 06 12:41:12 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:12 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:12 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-7fde9b63-c078-408a-b8b7-046270793c79" returned: 0 in 0.626s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Lock "cinder-quobyte-7fde9b63-c078-408a-b8b7-046270793c79" released by "delete_volume" :: held 1.509s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:13 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.info" returned: 0 in 0.694s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:13 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.info is being set with open permissions: ugo+rw Jul 06 12:41:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:13 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.info Jul 06 12:41:13 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:13 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Created reservations ['6e903ded-6865-48f9-ba72-a535d053a3cd', 'f0cdb4e9-0396-46aa-bdc4-e514c7168876', 'e58118a0-7623-42ee-a962-e1345ced4830', '61c51599-5902-4d87-9a73-19f6bfc4fa45'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:41:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:41:13 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:41:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:13 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:41:13 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:13 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.info" returned: 0 in 0.639s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.459s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:13 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-c465f1e8-82db-4a43-9fb3-249dd2810f15 tempest-ProjectMemberTests-1918340834 None] Create snapshot completed successfully Jul 06 12:41:13 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:13 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.686s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:13 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:41:13 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Deleted volume successfully. Jul 06 12:41:13 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b8b7aa8d-fd3f-47c8-b797-70983cd2b18a tempest-ProjectReaderTests-1070030554 None] Lock "cinder-7fde9b63-c078-408a-b8b7-046270793c79-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:14 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-918387dd-1639-49ac-88cd-44bb2bd3fdd7-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:14 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Lock "cinder-918387dd-1639-49ac-88cd-44bb2bd3fdd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:14 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-c08fe2da-18fe-4533-b4d8-88358c8b9f2c" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:14 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-c08fe2da-18fe-4533-b4d8-88358c8b9f2c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:14 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-918387dd-1639-49ac-88cd-44bb2bd3fdd7" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:14 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-918387dd-1639-49ac-88cd-44bb2bd3fdd7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Deleting offline snapshot 918387dd-1639-49ac-88cd-44bb2bd3fdd7 of volume c08fe2da-18fe-4533-b4d8-88358c8b9f2c {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:41:14 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] snapshot_file for this snap is: volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:41:14 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1294151e-fa48-4c30-8f5c-c8566fe8bc84]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:14 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:14 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7 Jul 06 12:41:14 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:15 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7" returned: 0 in 0.865s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:15 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:41:15 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[06272f1a-4abb-4c16-975e-789e942f50d3]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:15 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:15 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c Jul 06 12:41:15 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:16 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c" returned: 0 in 0.815s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:16 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:16 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7 Jul 06 12:41:16 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:17 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7" returned: 0 in 0.765s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:17 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7 Jul 06 12:41:17 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:17 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c.918387dd-1639-49ac-88cd-44bb2bd3fdd7" returned: 0 in 0.664s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:17 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-918387dd-1639-49ac-88cd-44bb2bd3fdd7" released by "_delete_snapshot" :: held 3.211s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:17 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-c08fe2da-18fe-4533-b4d8-88358c8b9f2c" released by "delete_snapshot" :: held 3.240s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:19 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Created reservations ['5eb6f897-935a-472a-a529-3f1f8884c41c', '1b2ccfea-fabd-4cc3-b07b-e6fa8eca762b', '5ac4eee8-6cde-44e5-b15a-18a7483e5cb9', '120f5f8d-4551-42ef-8c7d-28721a4d799d'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:41:21 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Delete snapshot completed successfully. Jul 06 12:41:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-a2b7b3ba-b615-4be7-ba22-a1de5bb74e5d tempest-ProjectMemberTests-1918340834 None] Lock "cinder-918387dd-1639-49ac-88cd-44bb2bd3fdd7-delete_snapshot" released by "delete_snapshot" :: held 6.844s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-c08fe2da-18fe-4533-b4d8-88358c8b9f2c-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Lock "cinder-c08fe2da-18fe-4533-b4d8-88358c8b9f2c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-c08fe2da-18fe-4533-b4d8-88358c8b9f2c" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:22 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-c08fe2da-18fe-4533-b4d8-88358c8b9f2c" acquired by "delete_volume" :: waited 0.015s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:22 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef15f8c-80e1-494a-b12d-62d14e0a656e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:22 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c Jul 06 12:41:22 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:23 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c" returned: 0 in 0.820s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:23 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c Jul 06 12:41:23 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:23 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-c08fe2da-18fe-4533-b4d8-88358c8b9f2c" returned: 0 in 0.693s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:23 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-c08fe2da-18fe-4533-b4d8-88358c8b9f2c" released by "delete_volume" :: held 1.576s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:23 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Created reservations ['72e42c8d-cd72-49e7-bdbe-b5bf7cbcdaa4', '1f2dd433-afa6-4ae9-809b-66127e353a4f', 'a5eb82e6-d1ce-434d-9447-098761a88051', 'd36fdc82-9f8c-4b16-9024-cd90d0c5a3f8'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:41:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:41:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:41:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:23 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:41:23 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:24 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.705s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:41:24 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Deleted volume successfully. Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-4edf36e6-4d9c-4612-9131-40662554810a tempest-ProjectMemberTests-1918340834 None] Lock "cinder-c08fe2da-18fe-4533-b4d8-88358c8b9f2c-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (2107c8ac-983e-4356-ba8c-ca05eaea215e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7149a35-d18b-4b55-96f1-a2cad1db4a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7149a35-d18b-4b55-96f1-a2cad1db4a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-267498841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87325a35-6784-4ced-aa71-53b5e96a66b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:41:25Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba428da-917b-4baf-93a3-915714489519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba428da-917b-4baf-93a3-915714489519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a2227a-399b-450c-8d95-9e1f6a398619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a2227a-399b-450c-8d95-9e1f6a398619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87325a35-6784-4ced-aa71-53b5e96a66b6', 'volume_name': 'volume-87325a35-6784-4ced-aa71-53b5e96a66b6', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8568158e-22f7-47c6-a794-2b825f2b111e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8568158e-22f7-47c6-a794-2b825f2b111e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59475dd9-6cd2-472e-b35e-e993d7460b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:24 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Volume 87325a35-6784-4ced-aa71-53b5e96a66b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87325a35-6784-4ced-aa71-53b5e96a66b6', 'volume_size': 1} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-267498841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87325a35-6784-4ced-aa71-53b5e96a66b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:41:25Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Creating volume 87325a35-6784-4ced-aa71-53b5e96a66b6 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:41:24 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:41:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:24 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6 1073741824 Jul 06 12:41:24 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:25 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6 1073741824" returned: 0 in 0.920s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:25 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=71,cinder:INSERT=23,cinder:UPDATE=84,cinder:DELETE=7 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:41:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:25 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6 Jul 06 12:41:25 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:26 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6" returned: 0 in 0.685s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:41:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:26 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=100,cinder:SELECT=73,cinder:DELETE=8,cinder:INSERT=28 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:41:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59475dd9-6cd2-472e-b35e-e993d7460b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87325a35-6784-4ced-aa71-53b5e96a66b6', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ebe2df-b835-4788-aa14-befa855c8f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:26 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Volume volume-87325a35-6784-4ced-aa71-53b5e96a66b6 (87325a35-6784-4ced-aa71-53b5e96a66b6): created successfully Jul 06 12:41:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ebe2df-b835-4788-aa14-befa855c8f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:26 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (2107c8ac-983e-4356-ba8c-ca05eaea215e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:41:26 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-a7d7ae07-80c7-445e-b4f6-8b3081673ac0 tempest-ProjectMemberTests-1918340834 None] Created volume successfully. Jul 06 12:41:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:27 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] Creating offline snapshot 3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 of volume 87325a35-6784-4ced-aa71-53b5e96a66b6 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:41:27 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2cfe78-9731-4154-8304-c00463f63079]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:27 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6 Jul 06 12:41:27 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:27 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6" returned: 0 in 0.762s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:27 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:27 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 1G Jul 06 12:41:27 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:28 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 1G" returned: 0 in 0.849s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:28 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87325a35-6784-4ced-aa71-53b5e96a66b6 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:28 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87325a35-6784-4ced-aa71-53b5e96a66b6 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 Jul 06 12:41:28 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:29 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87325a35-6784-4ced-aa71-53b5e96a66b6 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7" returned: 0 in 0.675s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:29 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 is being set with open permissions: ugo+rw Jul 06 12:41:29 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:29 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 Jul 06 12:41:29 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:30 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7" returned: 0 in 0.656s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:30 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.info Jul 06 12:41:30 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:30 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.info" returned: 0 in 0.662s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:30 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.info is being set with open permissions: ugo+rw Jul 06 12:41:30 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:30 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.info Jul 06 12:41:30 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:31 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.info" returned: 0 in 0.652s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:31 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.336s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:31 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-49284cd8-a79e-42d8-91a2-7523a5690e70 tempest-ProjectMemberTests-1918340834 None] Create snapshot completed successfully Jul 06 12:41:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-87325a35-6784-4ced-aa71-53b5e96a66b6" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-87325a35-6784-4ced-aa71-53b5e96a66b6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:32 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Deleting offline snapshot 3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 of volume 87325a35-6784-4ced-aa71-53b5e96a66b6 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:41:32 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] snapshot_file for this snap is: volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:41:32 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[231044b9-8cd6-4097-b80f-412e424bbd51]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:32 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:32 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 Jul 06 12:41:32 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:33 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7" returned: 0 in 0.775s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:33 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87325a35-6784-4ced-aa71-53b5e96a66b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:41:33 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f775bd7-edb0-4060-8b33-75e588b5a553]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:33 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:33 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6 Jul 06 12:41:33 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:34 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6" returned: 0 in 0.744s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:34 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 Jul 06 12:41:34 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:34 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7" returned: 0 in 0.698s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:34 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:34 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7 Jul 06 12:41:34 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:35 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6.3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7" returned: 0 in 0.630s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7" released by "_delete_snapshot" :: held 2.939s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-87325a35-6784-4ced-aa71-53b5e96a66b6" released by "delete_snapshot" :: held 2.960s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:35 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Created reservations ['9940eabc-9c50-41ab-bd62-47c165f5be66', 'ca1c9d4d-f711-4835-bb43-7400de89a717', '6e29cf9c-84ee-455f-9a49-d1f78ce51d91', '37f85a36-8b2c-409e-ba11-d69b46faa830'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:41:35 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Delete snapshot completed successfully. Jul 06 12:41:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-6074721b-51a8-476e-9032-85df80f60500 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-3f4bc9fd-2a8f-4350-8ddc-607ac12dc8f7-delete_snapshot" released by "delete_snapshot" :: held 3.097s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-87325a35-6784-4ced-aa71-53b5e96a66b6-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-87325a35-6784-4ced-aa71-53b5e96a66b6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-87325a35-6784-4ced-aa71-53b5e96a66b6" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:35 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-87325a35-6784-4ced-aa71-53b5e96a66b6" acquired by "delete_volume" :: waited 0.014s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:35 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df7acbc-0305-457e-8310-05f6bf5749aa]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:35 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:35 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6 Jul 06 12:41:35 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:36 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6" returned: 0 in 0.767s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:36 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:36 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6 Jul 06 12:41:36 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:37 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-87325a35-6784-4ced-aa71-53b5e96a66b6" returned: 0 in 0.657s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:37 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-87325a35-6784-4ced-aa71-53b5e96a66b6" released by "delete_volume" :: held 1.483s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:37 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Created reservations ['99f18def-598e-4299-8b79-0cc52ea6ab26', '80c7a03d-fe9d-4794-87e8-8abf56cdc97b', 'aa3bae45-57d5-468f-8e17-339a34c2f678', 'f45955d7-f73e-4009-96d7-1814ad2764b3'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:41:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:41:37 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:41:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:37 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:37 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:41:37 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:38 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.620s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:41:38 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Deleted volume successfully. Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3c0b7d6f-b4ed-49ce-8284-33cfadbfc214 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-87325a35-6784-4ced-aa71-53b5e96a66b6-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (43da25ce-6fdc-4bab-8eb9-22054dfed944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1e48f4-52f7-4f16-a370-8e590c6c9596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1e48f4-52f7-4f16-a370-8e590c6c9596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1200398574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e1bdca-f3e6-4053-92fb-864c342b0b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:41:38Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4aa93d-b53a-40f2-a00e-3df84f967479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4aa93d-b53a-40f2-a00e-3df84f967479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d94499-d722-4695-a0d9-d6613fc88c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d94499-d722-4695-a0d9-d6613fc88c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0e1bdca-f3e6-4053-92fb-864c342b0b6e', 'volume_name': 'volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (353e1cc9-d732-41bd-adc2-1ba8af965501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (353e1cc9-d732-41bd-adc2-1ba8af965501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77036075-7e0f-4e5c-a7d8-7c87ab109891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:38 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Volume d0e1bdca-f3e6-4053-92fb-864c342b0b6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e', 'volume_size': 1} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1200398574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e1bdca-f3e6-4053-92fb-864c342b0b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:41:38Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Creating volume d0e1bdca-f3e6-4053-92fb-864c342b0b6e {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:41:38 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:41:38 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:38 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e 1073741824 Jul 06 12:41:38 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:39 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e 1073741824" returned: 0 in 0.813s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:39 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e Jul 06 12:41:39 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:39 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e" returned: 0 in 0.618s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:39 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:41:39 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77036075-7e0f-4e5c-a7d8-7c87ab109891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a8502b-9e49-4c00-9dca-d791a643befc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:40 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Volume volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e (d0e1bdca-f3e6-4053-92fb-864c342b0b6e): created successfully Jul 06 12:41:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a8502b-9e49-4c00-9dca-d791a643befc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:40 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (43da25ce-6fdc-4bab-8eb9-22054dfed944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:41:40 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-6c005197-6886-4614-a2e9-32c8c429ccd3 tempest-ProjectMemberTests-1918340834 None] Created volume successfully. Jul 06 12:41:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:40 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] Creating offline snapshot 5f2dc129-5f50-4360-b13e-a0edcb6f44b6 of volume d0e1bdca-f3e6-4053-92fb-864c342b0b6e {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:41:40 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b47d850-8c1d-4b65-9497-e1c09c8e5fcf]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:40 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:40 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e Jul 06 12:41:40 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:41 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e" returned: 0 in 0.720s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:41 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:41 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6 1G Jul 06 12:41:41 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:42 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6 1G" returned: 0 in 0.780s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:42 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6 Jul 06 12:41:42 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:42 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6" returned: 0 in 0.665s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:42 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6 is being set with open permissions: ugo+rw Jul 06 12:41:42 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:42 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6 Jul 06 12:41:42 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:43 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6" returned: 0 in 0.613s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:43 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:43 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.info Jul 06 12:41:43 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:44 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.info" returned: 0 in 0.642s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:44 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.info is being set with open permissions: ugo+rw Jul 06 12:41:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:44 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.info Jul 06 12:41:44 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:44 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.info" returned: 0 in 0.675s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:44 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.175s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:44 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-f7135334-067f-460a-a0d2-4809e66ad776 tempest-ProjectMemberTests-1918340834 None] Create snapshot completed successfully Jul 06 12:41:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-5f2dc129-5f50-4360-b13e-a0edcb6f44b6-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-5f2dc129-5f50-4360-b13e-a0edcb6f44b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-d0e1bdca-f3e6-4053-92fb-864c342b0b6e" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-d0e1bdca-f3e6-4053-92fb-864c342b0b6e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-5f2dc129-5f50-4360-b13e-a0edcb6f44b6" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:45 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-5f2dc129-5f50-4360-b13e-a0edcb6f44b6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Deleting offline snapshot 5f2dc129-5f50-4360-b13e-a0edcb6f44b6 of volume d0e1bdca-f3e6-4053-92fb-864c342b0b6e {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:41:45 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] snapshot_file for this snap is: volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:41:45 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f4c918-aa29-4a9b-a95e-f0bdaa8478f8]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:45 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:46 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6 Jul 06 12:41:46 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:46 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6" returned: 0 in 0.750s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:46 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:41:46 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[be99366b-b718-4ff2-9701-f79a9a79637e]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:46 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:46 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e Jul 06 12:41:46 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:47 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e" returned: 0 in 0.761s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:47 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:47 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6 Jul 06 12:41:47 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:48 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6" returned: 0 in 0.695s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:48 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6 Jul 06 12:41:48 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:48 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:48 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e.5f2dc129-5f50-4360-b13e-a0edcb6f44b6" returned: 0 in 0.646s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-5f2dc129-5f50-4360-b13e-a0edcb6f44b6" released by "_delete_snapshot" :: held 2.938s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:48 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-d0e1bdca-f3e6-4053-92fb-864c342b0b6e" released by "delete_snapshot" :: held 2.958s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:48 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Created reservations ['7dc42e40-d018-4de7-930b-16bb71c65e3d', 'b880223b-5e94-4263-a0a0-815decf9c49e', '4b4c3f84-4807-40a6-9675-0968f216f872', 'e3e38fde-3f18-457d-b495-333def7dfc73'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:41:48 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Delete snapshot completed successfully. Jul 06 12:41:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-568d6746-7c9d-4701-937c-02c1bf96fbf4 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-5f2dc129-5f50-4360-b13e-a0edcb6f44b6-delete_snapshot" released by "delete_snapshot" :: held 3.088s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-d0e1bdca-f3e6-4053-92fb-864c342b0b6e-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-d0e1bdca-f3e6-4053-92fb-864c342b0b6e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-d0e1bdca-f3e6-4053-92fb-864c342b0b6e" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:49 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-d0e1bdca-f3e6-4053-92fb-864c342b0b6e" acquired by "delete_volume" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:49 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1909387b-49f2-44ca-8948-374343a2ae54]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:49 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e Jul 06 12:41:49 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:49 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e" returned: 0 in 0.757s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:49 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:49 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e Jul 06 12:41:49 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:50 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-d0e1bdca-f3e6-4053-92fb-864c342b0b6e" returned: 0 in 0.627s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:50 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-d0e1bdca-f3e6-4053-92fb-864c342b0b6e" released by "delete_volume" :: held 1.438s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:50 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Created reservations ['2fbf08f8-9849-46eb-b499-1a12e8c35b3e', '1f791841-ae57-474e-9664-9fc5e64a6e9b', '5078fd4e-63a8-4caf-9ed6-ec96da381c48', '14a0501d-5558-4dab-a1f0-215ce7192df2'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:41:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:41:50 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:41:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:50 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:50 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:41:50 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:51 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.641s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:41:51 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Deleted volume successfully. Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7dde5d82-e76b-4e68-8b8d-588f0054c827 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-d0e1bdca-f3e6-4053-92fb-864c342b0b6e-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (9f4b2b52-a442-45e2-869a-f64a70531d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb731fc-e202-42c4-abf4-7f7183fa4540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb731fc-e202-42c4-abf4-7f7183fa4540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138040555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23acb9ba-d35b-4c99-a0ea-0553e755d1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:41:52Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5ae337-1a7b-482b-9171-72c485efd17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5ae337-1a7b-482b-9171-72c485efd17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb2120c-901a-412d-8089-1a1f20e517a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb2120c-901a-412d-8089-1a1f20e517a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23acb9ba-d35b-4c99-a0ea-0553e755d1e5', 'volume_name': 'volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fabb3f-2824-427f-b749-a112283bda1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fabb3f-2824-427f-b749-a112283bda1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34543ed4-053f-4858-9b90-6ef5f5231ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:51 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Volume 23acb9ba-d35b-4c99-a0ea-0553e755d1e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5', 'volume_size': 1} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138040555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23acb9ba-d35b-4c99-a0ea-0553e755d1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d4aaf06c4fedb2244231ebfc62f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:41:52Z,use_quota=True,user_id='14efc8bf5a3647ac956c2184113efd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Creating volume 23acb9ba-d35b-4c99-a0ea-0553e755d1e5 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:41:51 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:41:51 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:51 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 1073741824 Jul 06 12:41:51 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:52 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:41:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:41:52 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:41:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:52 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:52 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:41:52 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 1073741824" returned: 0 in 0.770s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:52 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:52 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 Jul 06 12:41:52 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:53 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.677s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG oslo_service.periodic_task [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] Running periodic task VolumeManager._thread_info {{(pid=86761) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread count: 28 {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-aaf61b04-8767-43e9-8817-4f68738d4471 None None] thread info: [<_MainThread(MainThread, started 125805514903680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86761) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:41:53 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5" returned: 0 in 0.653s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34543ed4-053f-4858-9b90-6ef5f5231ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eaf0b51-040b-4d27-82eb-e6621ca02686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:53 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Volume volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 (23acb9ba-d35b-4c99-a0ea-0553e755d1e5): created successfully Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eaf0b51-040b-4d27-82eb-e6621ca02686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Flow 'volume_create_manager' (9f4b2b52-a442-45e2-869a-f64a70531d9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:41:53 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-3af12bde-d57e-4e25-a0ca-770cff6a1ba3 tempest-ProjectMemberTests-1918340834 None] Created volume successfully. Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] Creating offline snapshot 9776d394-0e6f-46f8-a00c-ca43d4491de0 of volume 23acb9ba-d35b-4c99-a0ea-0553e755d1e5 {{(pid=86761) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[071f93dc-7075-4a42-a6fe-d2b1209874e8]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:53 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:54 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 Jul 06 12:41:54 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:54 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5" returned: 0 in 0.773s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:54 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0 1G {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:54 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0 1G Jul 06 12:41:54 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:55 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0 1G" returned: 0 in 0.761s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:55 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:55 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0 Jul 06 12:41:55 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:56 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 -F qcow2 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0" returned: 0 in 0.670s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:56 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0 is being set with open permissions: ugo+rw Jul 06 12:41:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:56 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0 Jul 06 12:41:56 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:56 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0" returned: 0 in 0.615s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:56 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:56 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.info Jul 06 12:41:56 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:57 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.info" returned: 0 in 0.644s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:57 devstack cinder-volume[86761]: WARNING cinder.volume.drivers.remotefs [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.info is being set with open permissions: ugo+rw Jul 06 12:41:57 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.info {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:57 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.info Jul 06 12:41:57 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:58 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.info" returned: 0 in 0.620s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:58 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.156s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:58 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-e6c72aae-c093-477a-a7e8-81e3bd956cc7 tempest-ProjectMemberTests-1918340834 None] Create snapshot completed successfully Jul 06 12:41:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-9776d394-0e6f-46f8-a00c-ca43d4491de0-delete_snapshot" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-9776d394-0e6f-46f8-a00c-ca43d4491de0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-23acb9ba-d35b-4c99-a0ea-0553e755d1e5" by "delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-23acb9ba-d35b-4c99-a0ea-0553e755d1e5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-9776d394-0e6f-46f8-a00c-ca43d4491de0" by "_delete_snapshot" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:59 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-9776d394-0e6f-46f8-a00c-ca43d4491de0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Deleting offline snapshot 9776d394-0e6f-46f8-a00c-ca43d4491de0 of volume 23acb9ba-d35b-4c99-a0ea-0553e755d1e5 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:41:59 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] snapshot_file for this snap is: volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0 {{(pid=86761) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:41:59 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e1b0a0-ddb1-4d44-9f39-78dbf3f017ac]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:59 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:59 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0 Jul 06 12:41:59 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:00 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0" returned: 0 in 0.735s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:00 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86761) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:42:00 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57306f9-42bd-432b-837b-7e76f1893688]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:42:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:00 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 Jul 06 12:42:00 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:00 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5" returned: 0 in 0.778s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:00 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:00 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0 Jul 06 12:42:00 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:01 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0" returned: 0 in 0.753s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:01 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:01 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0 Jul 06 12:42:01 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:02 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:02 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5.9776d394-0e6f-46f8-a00c-ca43d4491de0" returned: 0 in 0.686s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-9776d394-0e6f-46f8-a00c-ca43d4491de0" released by "_delete_snapshot" :: held 3.041s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:42:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-23acb9ba-d35b-4c99-a0ea-0553e755d1e5" released by "delete_snapshot" :: held 3.065s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:42:02 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Created reservations ['9cd0b4ae-2303-4f15-a715-309bc8f6f975', 'e888131b-7cb0-4c95-b7da-029ef5dceb32', '62627613-79d6-464e-85ab-942cef0ab275', '800f9014-44e0-4af1-9854-45429a4109a5'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:42:02 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Delete snapshot completed successfully. Jul 06 12:42:02 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-b6799de8-7b8b-4415-8db0-90052ce583c5 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-9776d394-0e6f-46f8-a00c-ca43d4491de0-delete_snapshot" released by "delete_snapshot" :: held 3.237s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:42:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-23acb9ba-d35b-4c99-a0ea-0553e755d1e5-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:42:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-23acb9ba-d35b-4c99-a0ea-0553e755d1e5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:42:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "cinder-quobyte-23acb9ba-d35b-4c99-a0ea-0553e755d1e5" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:42:03 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-23acb9ba-d35b-4c99-a0ea-0553e755d1e5" acquired by "delete_volume" :: waited 0.024s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:42:03 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[1add6506-2ed0-4724-a631-5aad3cc25271]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:42:03 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:03 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 Jul 06 12:42:03 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:04 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5" returned: 0 in 0.763s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:04 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:04 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5 Jul 06 12:42:04 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:05 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-23acb9ba-d35b-4c99-a0ea-0553e755d1e5" returned: 0 in 0.666s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-quobyte-23acb9ba-d35b-4c99-a0ea-0553e755d1e5" released by "delete_volume" :: held 1.494s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:42:05 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Created reservations ['1badfb8e-6977-482f-b4d9-9b2761ec02af', 'b5d34314-0830-42db-8dc7-f291c3480168', 'f23d33d1-ce31-4ece-8690-b749988f940a', 'b8d6a732-355d-4055-9fab-076b7b2d96ff'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:42:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:42:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:42:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:42:05 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:42:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:42:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:05 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:42:05 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:05 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:05 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.683s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:05 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:42:05 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Deleted volume successfully. Jul 06 12:42:05 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-10dc3e1d-feb7-4428-bf04-c100f6923ed2 tempest-ProjectMemberTests-1918340834 None] Lock "cinder-23acb9ba-d35b-4c99-a0ea-0553e755d1e5-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:42:15 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:DELETE=5,cinder:SELECT=45,cinder:UPDATE=47,cinder:INSERT=11 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:42:15 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=36,cinder:UPDATE=58,cinder:INSERT=18,cinder:DELETE=4 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Flow 'volume_create_manager' (4c5ccdff-3fd1-471f-a519-65741bcfe1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6df6fc4-0cbc-4509-a4ab-8ee0207e8cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6df6fc4-0cbc-4509-a4ab-8ee0207e8cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1132967956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49884829-9ee4-4c30-9794-5379344e965d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33e32a28c0ad413189e6ed63c2725ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:42:17Z,use_quota=True,user_id='dd6e11ca310e4c3cbb5ff9eafe7c1ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fda78b8-2a8b-48b3-8fde-35e75e16ef49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fda78b8-2a8b-48b3-8fde-35e75e16ef49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ceb3d6-fd81-43aa-86a4-065462d58b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ceb3d6-fd81-43aa-86a4-065462d58b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49884829-9ee4-4c30-9794-5379344e965d', 'volume_name': 'volume-49884829-9ee4-4c30-9794-5379344e965d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6690cd1d-d30e-4d4a-be7a-ee68da4be298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6690cd1d-d30e-4d4a-be7a-ee68da4be298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9739a84-289d-43bc-9a32-679f6637723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:42:17 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Volume 49884829-9ee4-4c30-9794-5379344e965d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49884829-9ee4-4c30-9794-5379344e965d', 'volume_size': 1} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1132967956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49884829-9ee4-4c30-9794-5379344e965d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33e32a28c0ad413189e6ed63c2725ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:42:17Z,use_quota=True,user_id='dd6e11ca310e4c3cbb5ff9eafe7c1ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Creating volume 49884829-9ee4-4c30-9794-5379344e965d {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:42:17 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:42:17 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49884829-9ee4-4c30-9794-5379344e965d 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:17 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49884829-9ee4-4c30-9794-5379344e965d 1073741824 Jul 06 12:42:17 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:18 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49884829-9ee4-4c30-9794-5379344e965d 1073741824" returned: 0 in 0.816s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49884829-9ee4-4c30-9794-5379344e965d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:18 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49884829-9ee4-4c30-9794-5379344e965d Jul 06 12:42:18 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:18 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49884829-9ee4-4c30-9794-5379344e965d" returned: 0 in 0.628s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:18 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:42:18 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:42:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9739a84-289d-43bc-9a32-679f6637723c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49884829-9ee4-4c30-9794-5379344e965d', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:42:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c536ad57-7f2c-435a-9818-bdd02eeb5f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:42:18 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Volume volume-49884829-9ee4-4c30-9794-5379344e965d (49884829-9ee4-4c30-9794-5379344e965d): created successfully Jul 06 12:42:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c536ad57-7f2c-435a-9818-bdd02eeb5f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:42:18 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Flow 'volume_create_manager' (4c5ccdff-3fd1-471f-a519-65741bcfe1d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:42:18 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-971946dd-2652-4965-aa1c-493a70e9ed91 tempest-ProjectReaderTests-591181439 None] Created volume successfully. Jul 06 12:42:19 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Acquiring lock "cinder-49884829-9ee4-4c30-9794-5379344e965d-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:42:19 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Lock "cinder-49884829-9ee4-4c30-9794-5379344e965d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:42:19 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Acquiring lock "cinder-quobyte-49884829-9ee4-4c30-9794-5379344e965d" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:42:19 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Lock "cinder-quobyte-49884829-9ee4-4c30-9794-5379344e965d" acquired by "delete_volume" :: waited 0.014s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:42:19 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b528f6-1e4c-415c-96c6-03adbe877920]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:42:19 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49884829-9ee4-4c30-9794-5379344e965d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:19 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49884829-9ee4-4c30-9794-5379344e965d Jul 06 12:42:19 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:20 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49884829-9ee4-4c30-9794-5379344e965d" returned: 0 in 0.748s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:20 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49884829-9ee4-4c30-9794-5379344e965d {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:20 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49884829-9ee4-4c30-9794-5379344e965d Jul 06 12:42:20 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:21 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-49884829-9ee4-4c30-9794-5379344e965d" returned: 0 in 0.646s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Lock "cinder-quobyte-49884829-9ee4-4c30-9794-5379344e965d" released by "delete_volume" :: held 1.431s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:42:21 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Created reservations ['994d24f5-aac4-4118-8e46-6e4fa4d62010', '4c5e487c-d022-4626-8006-2ab688298fa0', 'c460b460-e649-4a5d-ab26-6eb8078b2b2a', '239811eb-ec5a-4502-850d-ad3abc7647ef'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:42:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:42:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:42:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:42:21 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:42:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:42:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:21 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:42:21 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:21 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:21 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.694s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:21 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:42:21 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Deleted volume successfully. Jul 06 12:42:21 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-3bee4f20-7e7b-4c20-811f-d999874dda43 tempest-ProjectReaderTests-591181439 None] Lock "cinder-49884829-9ee4-4c30-9794-5379344e965d-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.flows.manager.create_volume [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86761) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Flow 'volume_create_manager' (dbdceb31-515b-47c5-af33-2705cf69b043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e325f168-1dcd-4999-98ee-ae074e324a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e325f168-1dcd-4999-98ee-ae074e324a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1195572844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983a78a5-3dcc-4227-9838-d0c1508d4316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33e32a28c0ad413189e6ed63c2725ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:42:22Z,use_quota=True,user_id='dd6e11ca310e4c3cbb5ff9eafe7c1ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b568cc1a-36f9-4e5b-9998-f031c1637f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b568cc1a-36f9-4e5b-9998-f031c1637f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9f8201-bda0-47ba-acbb-60dc5d804a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9f8201-bda0-47ba-acbb-60dc5d804a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '983a78a5-3dcc-4227-9838-d0c1508d4316', 'volume_name': 'volume-983a78a5-3dcc-4227-9838-d0c1508d4316', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfbc5e0-59cc-4f43-afaf-282f1ec9a052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfbc5e0-59cc-4f43-afaf-282f1ec9a052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2e7459-bbc2-445d-9035-79b320a0f644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:42:22 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Volume 983a78a5-3dcc-4227-9838-d0c1508d4316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-983a78a5-3dcc-4227-9838-d0c1508d4316', 'volume_size': 1} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1195572844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983a78a5-3dcc-4227-9838-d0c1508d4316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33e32a28c0ad413189e6ed63c2725ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:42:22Z,use_quota=True,user_id='dd6e11ca310e4c3cbb5ff9eafe7c1ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77a50ac-5e56-4e53-a9b6-f7d99ee8df95),volume_type_id=c77a50ac-5e56-4e53-a9b6-f7d99ee8df95)}" {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.remotefs [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Creating volume 983a78a5-3dcc-4227-9838-d0c1508d4316 {{(pid=86761) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Selected osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a as target Quobyte volume. {{(pid=86761) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:42:22 devstack cinder-volume[86761]: INFO cinder.volume.drivers.remotefs [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] casted to osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a Jul 06 12:42:22 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-983a78a5-3dcc-4227-9838-d0c1508d4316 1073741824 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:22 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-983a78a5-3dcc-4227-9838-d0c1508d4316 1073741824 Jul 06 12:42:22 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:23 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-983a78a5-3dcc-4227-9838-d0c1508d4316 1073741824" returned: 0 in 0.825s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-983a78a5-3dcc-4227-9838-d0c1508d4316 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:23 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-983a78a5-3dcc-4227-9838-d0c1508d4316 Jul 06 12:42:23 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:23 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-983a78a5-3dcc-4227-9838-d0c1508d4316" returned: 0 in 0.651s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:23 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'} {{(pid=86761) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:42:23 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:42:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2e7459-bbc2-445d-9035-79b320a0f644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-983a78a5-3dcc-4227-9838-d0c1508d4316', 'volume_size': 1}' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:42:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7110c0-4e70-49ad-913f-b4d0958c7ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:42:23 devstack cinder-volume[86761]: INFO cinder.volume.flows.manager.create_volume [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Volume volume-983a78a5-3dcc-4227-9838-d0c1508d4316 (983a78a5-3dcc-4227-9838-d0c1508d4316): created successfully Jul 06 12:42:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7110c0-4e70-49ad-913f-b4d0958c7ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86761) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:42:23 devstack cinder-volume[86761]: DEBUG cinder.volume.manager [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Flow 'volume_create_manager' (dbdceb31-515b-47c5-af33-2705cf69b043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86761) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:42:23 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-14250798-2bcf-45bd-8ca9-22158623b2ca tempest-ProjectReaderTests-591181439 None] Created volume successfully. Jul 06 12:42:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Acquiring lock "cinder-983a78a5-3dcc-4227-9838-d0c1508d4316-delete_volume" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:42:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Lock "cinder-983a78a5-3dcc-4227-9838-d0c1508d4316-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:42:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Acquiring lock "cinder-quobyte-983a78a5-3dcc-4227-9838-d0c1508d4316" by "delete_volume" {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:42:24 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Lock "cinder-quobyte-983a78a5-3dcc-4227-9838-d0c1508d4316" acquired by "delete_volume" :: waited 0.016s {{(pid=86761) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:42:24 devstack cinder-volume[86761]: DEBUG oslo.privsep.daemon [-] privsep: reply[14281b27-59b3-4147-97a4-5f44549203c0]: (4, 'qcow2') {{(pid=87831) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:42:24 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-983a78a5-3dcc-4227-9838-d0c1508d4316 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:24 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-983a78a5-3dcc-4227-9838-d0c1508d4316 Jul 06 12:42:24 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:25 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-983a78a5-3dcc-4227-9838-d0c1508d4316" returned: 0 in 0.821s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-983a78a5-3dcc-4227-9838-d0c1508d4316 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:25 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-983a78a5-3dcc-4227-9838-d0c1508d4316 Jul 06 12:42:25 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:25 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:25 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82/volume-983a78a5-3dcc-4227-9838-d0c1508d4316" returned: 0 in 0.674s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:25 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Lock "cinder-quobyte-983a78a5-3dcc-4227-9838-d0c1508d4316" released by "delete_volume" :: held 1.533s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:42:26 devstack cinder-volume[86761]: DEBUG cinder.quota [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Created reservations ['b38b0ac8-bbb3-4fc1-9a09-63141b9f260b', '4ba789b7-a25c-4f47-bb0c-58625d37a7ee', '0bce0d4d-0807-45a6-946d-0ddacec278bb', '35814de8-d79b-439e-8dc6-18e0b69ff62a'] {{(pid=86761) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:42:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:42:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:42:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a': None} {{(pid=86761) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:42:26 devstack cinder-volume[86761]: DEBUG cinder.volume.drivers.quobyte [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-123842c4-0b33-4d7d-8f75-5816a0dd5f3a'] {{(pid=86761) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:42:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.lockutils [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86761) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:42:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:26 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82 Jul 06 12:42:26 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:26 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:26 devstack cinder-volume[86761]: DEBUG oslo_concurrency.processutils [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5f6c84252028d6dad624de88f164e82" returned: 0 in 0.697s {{(pid=86761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:26 devstack cinder-volume[86761]: DEBUG cinder.manager [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Notifying Schedulers of capabilities ... {{(pid=86761) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:42:26 devstack cinder-volume[86761]: INFO cinder.volume.manager [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Deleted volume successfully. Jul 06 12:42:26 devstack cinder-volume[86761]: DEBUG cinder.coordination [None req-7296631c-e979-4421-b4f6-3db5c15ce141 tempest-ProjectReaderTests-591181439 None] Lock "cinder-983a78a5-3dcc-4227-9838-d0c1508d4316-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=86761) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:42:36 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:UPDATE=22,cinder:SELECT=15,cinder:INSERT=5 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:42:36 devstack cinder-volume[86761]: DEBUG dbcounter [-] [86761] Writing DB stats cinder:SELECT=13,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=4 {{(pid=86761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}